Feb 27 01:57:45 devstack cinder-volume[72950]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72950) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 01:57:45 devstack cinder-volume[72950]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72950) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 01:57:45 devstack cinder-volume[72950]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72950) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 01:57:45 devstack cinder-volume[72950]: INFO dbcounter [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Registered counter for database cinder Feb 27 01:57:45 devstack cinder-volume[72950]: DEBUG oslo_db.sqlalchemy.engines [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72950) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:57:45 devstack cinder-volume[72950]: DEBUG dbcounter [-] [72950] Writer thread running {{(pid=72950) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 01:57:45 devstack cinder-volume[72950]: INFO cinder.rpc [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 01:57:45 devstack cinder-volume[72950]: INFO cinder.rpc [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 01:57:45 devstack cinder-volume[72950]: DEBUG oslo_db.sqlalchemy.engines [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72950) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:57:45 devstack cinder-volume[72950]: INFO cinder.volume.manager [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Determined volume DB was empty at startup. Feb 27 01:57:45 devstack cinder-volume[72950]: DEBUG cinder.volume.manager [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72950) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 01:57:45 devstack cinder-volume[72950]: INFO cinder.volume.manager [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 27 01:57:45 devstack cinder-volume[72950]: WARNING stevedore.named [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 01:57:45 devstack cinder-volume[72950]: WARNING castellan.key_manager [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 01:57:45 devstack cinder-volume[72950]: WARNING cinder.keymgr.conf_key_mgr [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 01:57:45 devstack cinder-volume[72950]: DEBUG cinder.volume.drivers.lvm [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72950) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Feb 27 01:57:45 devstack cinder-volume[72950]: DEBUG oslo_concurrency.processutils [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72950) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_concurrency.processutils [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] CMD "cinder-rtstool verify" returned: 0 in 0.263s {{(pid=72950) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_db.sqlalchemy.engines [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72950) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:57:46 devstack cinder-volume[72950]: INFO cinder.rpc [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Feb 27 01:57:46 devstack cinder-volume[72950]: INFO cinder.rpc [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Feb 27 01:57:46 devstack cinder-volume[72950]: WARNING stevedore.named [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 01:57:46 devstack cinder-volume[72950]: WARNING castellan.key_manager [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 01:57:46 devstack cinder-volume[72950]: INFO cinder.volume.manager [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_db.sqlalchemy.engines [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72950) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:57:46 devstack cinder-volume[72950]: INFO oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Starting 1 workers Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Started child 73051 {{(pid=72950) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Full set of CONF: {{(pid=72950) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] ******************************************************************************** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Configuration options gathered from: {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 01:57:46 devstack cinder-volume[73051]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] ================================================================================ {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] allow_availability_zone_fallback = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] allow_compression_on_image_upload = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] allowed_direct_url_schemes = [] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] api_rate_limit = True {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] auth_strategy = keystone {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] az_cache_duration = 3600 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_availability_zone = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_host = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_name = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_stats_polling_interval = 60 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backup_api_class = cinder.backup.api.API {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backup_name_template = backup-%s {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backup_use_same_host = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backup_use_temp_snapshot = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] chap_password = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] chap_username = {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cinder_internal_tenant_project_id = e3e7d66eb6554aa5b76e1418922cc5d5 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cinder_internal_tenant_user_id = 33f3405778cb4385858d6011405af76a {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cloned_volume_same_az = True {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cluster = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] compression_format = gzip {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] compute_api_class = cinder.compute.nova.API {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] config_dir = [] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] config_source = [] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] control_exchange = openstack {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] debug = True {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] default_availability_zone = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] default_group_type = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] default_volume_type = lvmdriver-1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] disk_geometry = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] driver_client_cert = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] driver_client_cert_key = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] driver_data_namespace = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] driver_ssl_cert_path = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] driver_ssl_cert_verify = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] driver_use_ssl = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] enable_force_upload = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] enable_new_services = True {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] enable_unsupported_driver = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] enabled_backends = ['lvmdriver-1'] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] enforce_multipath_for_image_xfer = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] filter_function = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] glance_api_insecure = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] glance_api_servers = ['http://192.168.122.23/image'] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] glance_api_ssl_compression = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] glance_ca_certificates_file = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] glance_catalog_info = image:glance:publicURL {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] glance_certfile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] glance_keyfile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] glance_num_retries = 3 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] glance_request_timeout = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] goodness_function = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] graceful_shutdown_timeout = 5 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] group_api_class = cinder.group.api.API {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] host = devstack {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] image_compress_on_upload = True {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] image_conversion_address_space_limit = 1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] image_conversion_cpu_limit = 60 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] image_conversion_disable = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] image_upload_use_cinder_backend = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] image_upload_use_internal_tenant = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] image_volume_cache_enabled = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] image_volume_cache_max_count = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] image_volume_cache_max_size_gb = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] init_host_max_objects_retrieval = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] instance_format = [instance: %(uuid)s] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] iscsi_target_flags = {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] iscsi_write_cache = on {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] iser_helper = tgtadm {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[73051]: INFO cinder.volume.manager [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Starting volume driver LVMVolumeDriver (3.0.0) Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] iser_ip_address = 192.168.122.23 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] iser_port = 3260 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] log_color = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] log_config_append = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] log_dir = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] log_file = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] log_options = True {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] log_rotate_interval = 1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] log_rotate_interval_type = days {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] log_rotation_type = none {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] max_age = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] max_logfile_count = 30 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] max_logfile_size_mb = 200 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] max_over_subscription_ratio = 20.0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] message_reap_interval = 86400 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] message_ttl = 2592000 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] migration_create_volume_timeout_secs = 300 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] monkey_patch = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] monkey_patch_modules = [] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] my_ip = 192.168.122.23 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] no_snapshot_gb_quota = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] num_iser_scan_tries = 3 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] num_shell_tries = 3 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] num_volume_device_scan_tries = 3 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] nvmeof_conn_info_version = 1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] nvmet_ns_id = 10 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] nvmet_port_id = 1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] osapi_max_limit = 1000 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] osapi_volume_ext_list = [] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] osapi_volume_listen = 0.0.0.0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] osapi_volume_listen_port = 8776 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] osapi_volume_use_ssl = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] osapi_volume_workers = 2 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] per_volume_size_limit = -1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] periodic_fuzzy_delay = 60 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] periodic_interval = 60 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] project_id_regex = [0-9a-f\-]+ {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] public_endpoint = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] publish_errors = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] quota_backup_gigabytes = 1000 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] quota_backups = 10 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] quota_gigabytes = 1000 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] quota_groups = 10 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] quota_snapshots = 10 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] quota_volumes = 10 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] rate_limit_burst = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] rate_limit_except_level = CRITICAL {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] rate_limit_interval = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] reinit_driver_count = 3 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] replication_device = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] report_discard_supported = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] report_interval = 120 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] reservation_clean_interval = 86400 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] reservation_expire = 86400 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] reserved_image_namespaces = [] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] reserved_percentage = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] rpc_response_timeout = 120 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] run_external_periodic_tasks = True {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] scst_target_driver = iscsi {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] scst_target_iqn_name = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] service_down_time = 720 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] shell_completion = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] snapshot_name_template = snapshot-%s {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] snapshot_same_host = True {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] split_loggers = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] state_path = /opt/stack/data/cinder {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] storage_availability_zone = nova {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] storage_protocol = iSCSI {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] syslog_log_facility = LOG_USER {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] target_helper = lioadm {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] target_ip_address = 192.168.122.23 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] target_port = 3260 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] target_protocol = iscsi {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] target_secondary_ip_addresses = [] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] trace_flags = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] transfer_api_class = cinder.transfer.api.API {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] transport_url = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] until_refresh = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] use_chap_auth = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] use_default_quota_class = True {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] use_journal = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] use_json = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] use_multipath_for_image_xfer = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] use_stderr = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] use_syslog = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] verify_glance_signatures = enabled {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] volume_api_class = cinder.volume.api.API {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] volume_backend_name = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] volume_clear = zero {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] volume_clear_ionice = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] volume_clear_size = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] volume_copy_bps_limit = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] volume_dd_blocksize = 1M {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] volume_name_template = volume-%s {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] volume_service_inithost_offload = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] volume_usage_audit_period = month {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] zoning_mode = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_concurrency.disable_process_locking = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.admin_password = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.admin_token = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.admin_user = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.auth_admin_prefix = {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.auth_port = 35357 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.auth_protocol = https {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.auth_section = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.auth_type = password {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.auth_uri = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.auth_version = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.cache = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.certfile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.delay_auth_decision = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.http_connect_timeout = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.identity_uri = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.include_service_catalog = True {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.insecure = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.interface = public {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.keyfile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.memcache_password = {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.memcache_username = {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.region_name = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.service_token_roles_required = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.service_type = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.token_cache_time = 300 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.23/identity {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.backend = dogpile.cache.null {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.backend_argument = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.backend_expiration_time = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.config_prefix = cache.oslo {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.debug_cache_backend = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.enable_retry_client = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.enable_socket_keepalive = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.enabled = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.enforce_fips_mode = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.expiration_time = 600 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:46 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.hashclient_retry_attempts = 2 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.memcache_dead_retry = 300 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.memcache_pool_maxsize = 10 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.memcache_sasl_enabled = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.password = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.proxies = [] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.redis_db = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.redis_sentinel_service_name = mymaster {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.redis_server = localhost:6379 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.retry_attempts = 2 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.retry_delay = 0.0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.socket_keepalive_count = 1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.socket_keepalive_idle = 1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.socket_keepalive_interval = 1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.socket_timeout = 1.0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.tls_allowed_ciphers = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.tls_cafile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.tls_certfile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.tls_enabled = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.tls_keyfile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cache.username = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] coordination.backend_url = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.asyncio_connection = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.asyncio_slave_connection = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.backend = sqlalchemy {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.connection = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.connection_debug = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.connection_parameters = {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.connection_recycle_time = 3600 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.connection_trace = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.db_inc_retry_interval = True {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.db_max_retries = 20 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.db_max_retry_interval = 10 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.db_retry_interval = 1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.max_overflow = 50 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.max_pool_size = 5 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.max_retries = 10 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.mysql_wsrep_sync_wait = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.pool_timeout = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.retry_interval = 10 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.slave_connection = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.sqlite_synchronous = True {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.synchronous_reader = True {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] database.use_db_reconnect = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] profiler.connection_string = messaging:// {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] profiler.enabled = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] profiler.es_doc_type = notification {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] profiler.es_scroll_size = 10000 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] profiler.es_scroll_time = 2m {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] profiler.filter_error_trace = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] profiler.hmac_keys = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] profiler.sentinel_service_name = mymaster {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] profiler.socket_timeout = 0.1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] profiler.trace_requests = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] profiler.trace_sqlalchemy = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] profiler_jaeger.process_tags = {} {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] profiler_jaeger.service_name_prefix = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] profiler_otlp.service_name_prefix = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_policy.enforce_new_defaults = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: WARNING oslo_config.cfg [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_policy.enforce_scope = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_policy.policy_default_rule = default {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_policy.policy_file = policy.yaml {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack sudo[73055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_policy.remote_timeout = 60.0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] privsep_osbrick.group = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] privsep_osbrick.helper_command = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack sudo[73055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] privsep_osbrick.user = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cinder_sys_admin.group = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cinder_sys_admin.helper_command = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] cinder_sys_admin.user = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] service_user.auth_section = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] service_user.auth_type = password {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] service_user.cafile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] service_user.certfile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] service_user.collect_timing = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] service_user.insecure = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] service_user.keyfile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] service_user.send_service_user_token = True {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] service_user.split_loggers = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] service_user.timeout = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] glance.auth_section = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] glance.auth_type = password {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] glance.certfile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] glance.collect_timing = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] glance.insecure = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] glance.keyfile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] glance.region_name = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] glance.split_loggers = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] glance.timeout = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.backend_availability_zone = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.chap_password = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.chap_username = {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.disk_geometry = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.driver_client_cert = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.driver_client_cert_key = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.driver_data_namespace = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.driver_use_ssl = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.enable_unsupported_driver = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.extra_capabilities = {} {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.filter_function = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.goodness_function = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.iscsi_target_flags = {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.iscsi_write_cache = on {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.iser_helper = tgtadm {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.iser_ip_address = 192.168.122.23 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.iser_port = 3260 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.lvm_mirrors = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.lvm_share_target = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.lvm_type = auto {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.num_shell_tries = 3 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.nvmet_port_id = 1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.replication_device = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.report_discard_supported = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.reserved_percentage = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.scst_target_driver = iscsi {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.scst_target_iqn_name = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.storage_protocol = iSCSI {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.target_helper = tgtadm {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.target_ip_address = 192.168.122.23 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.target_port = 3260 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.target_protocol = iscsi {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.trace_flags = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.unique_fqdn_network = True {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.use_chap_auth = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.volume_backend_name = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.volume_clear = zero {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.volume_clear_ionice = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.volume_clear_size = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.volume_group = cinder-volumes {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_reports.file_event_handler = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_reports.log_dir = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.backend_availability_zone = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.backend_host = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.chap_password = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.chap_username = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.chiscsi_conf = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.disk_geometry = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.driver_client_cert = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.driver_data_namespace = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.driver_use_ssl = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.extra_capabilities = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.filter_function = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.goodness_function = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.iser_helper = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.iser_ip_address = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.iser_port = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.iser_target_prefix = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.lvm_conf_file = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.lvm_mirrors = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.lvm_share_target = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.lvm_type = auto {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.num_shell_tries = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.nvmet_port_id = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.replication_device = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.report_discard_supported = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.reserved_percentage = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.scst_target_driver = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.storage_protocol = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.target_helper = lioadm {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.target_ip_address = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.target_port = 3260 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.target_protocol = iscsi {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.trace_flags = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.use_chap_auth = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.volume_clear = zero {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.volume_clear_size = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] lvmdriver-1.volumes_dir = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.ssl = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.ssl_version = {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_notifications.driver = [] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_notifications.retry = -1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] oslo_messaging_notifications.transport_url = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] key_manager.fixed_key = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican.barbican_api_version = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican.barbican_endpoint = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican.barbican_endpoint_type = public {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican.barbican_region_name = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican.cafile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican.certfile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican.collect_timing = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican.insecure = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican.keyfile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican.number_of_retries = 60 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican.retry_delay = 1 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican.send_service_user_token = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican.split_loggers = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican.timeout = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican.verify_ssl = True {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican.verify_ssl_path = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican_service_user.auth_section = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican_service_user.auth_type = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican_service_user.cafile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican_service_user.certfile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican_service_user.collect_timing = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican_service_user.insecure = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican_service_user.keyfile = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican_service_user.split_loggers = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] barbican_service_user.timeout = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] vault.approle_role_id = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] vault.approle_secret_id = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] vault.kv_mountpoint = secret {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] vault.kv_path = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] vault.kv_version = 2 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] vault.namespace = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] vault.root_token_id = **** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] vault.ssl_ca_crt_file = None {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] vault.timeout = 60.0 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] vault.use_ssl = False {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:57:46 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] ******************************************************************************** {{(pid=72950) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 01:57:47 devstack sudo[73055]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:47 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:47 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:47 devstack sudo[73216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:57:47 devstack sudo[73216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:47 devstack sudo[73216]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:47 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.559s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:47 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 01:57:47 devstack cinder-volume[73051]: INFO cinder.brick.local_dev.lvm [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Feb 27 01:57:47 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:47 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:47 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:47 devstack sudo[73417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:57:47 devstack sudo[73417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:48 devstack sudo[73417]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:48 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.602s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:48 devstack cinder-volume[73051]: DEBUG cinder.brick.local_dev.lvm [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73051) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Feb 27 01:57:48 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:48 devstack sudo[73572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:57:48 devstack sudo[73572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:49 devstack sudo[73572]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:49 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.885s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:49 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:49 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:49 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:49 devstack sudo[73734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:57:49 devstack sudo[73734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:49 devstack sudo[73734]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:49 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.450s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:49 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:49 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:49 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:49 devstack sudo[73741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Feb 27 01:57:49 devstack sudo[73741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:50 devstack sudo[73741]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:50 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.446s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:50 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:50 devstack sudo[73744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:57:50 devstack sudo[73744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:50 devstack sudo[73744]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:50 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:50 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:50 devstack sudo[73751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:57:50 devstack sudo[73751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:50 devstack sudo[73751]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:50 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:50 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:50 devstack sudo[73754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:57:50 devstack sudo[73754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:51 devstack sudo[73754]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:51 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:51 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:51 devstack sudo[73762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:57:51 devstack sudo[73762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:51 devstack sudo[73762]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:51 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.422s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:51 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:51 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:51 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:51 devstack sudo[73766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:57:51 devstack sudo[73766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:52 devstack sudo[73766]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:52 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.430s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:52 devstack cinder-volume[73051]: INFO cinder.volume.drivers.lvm [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Enabling LVM thin provisioning by default because a thin pool exists. Feb 27 01:57:52 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:52 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:52 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:52 devstack sudo[73775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:57:52 devstack sudo[73775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:52 devstack sudo[73775]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:52 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.503s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:52 devstack cinder-volume[73051]: DEBUG cinder.volume.drivers.lvm [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Updating volume stats {{(pid=73051) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:57:52 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:52 devstack sudo[73887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:57:52 devstack sudo[73887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:53 devstack sudo[73887]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:53 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:53 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:53 devstack sudo[74027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:57:53 devstack sudo[74027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:53 devstack sudo[74027]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:53 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:53 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:53 devstack sudo[74031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:57:53 devstack sudo[74031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:54 devstack sudo[74031]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:54 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.472s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:54 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:54 devstack sudo[74034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:57:54 devstack sudo[74034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:54 devstack sudo[74034]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:54 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:54 devstack cinder-volume[73051]: INFO cinder.volume.driver [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Driver hasn't implemented _init_vendor_properties() Feb 27 01:57:54 devstack cinder-volume[73051]: DEBUG cinder.volume.driver [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73051) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 01:57:54 devstack cinder-volume[73051]: DEBUG oslo_db.sqlalchemy.engines [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73051) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:57:54 devstack cinder-volume[73051]: DEBUG dbcounter [-] [73051] Writer thread running {{(pid=73051) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 01:57:54 devstack cinder-volume[73051]: DEBUG cinder.db.sqlalchemy.api [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Building query based on filter {{(pid=73051) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 01:57:54 devstack cinder-volume[73051]: DEBUG cinder.image.image_utils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73051) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 01:57:54 devstack cinder-volume[73051]: INFO cinder.keymgr.migration [None req-c4759a3f-f326-4e3f-b0ea-5baef3588db4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 01:57:54 devstack cinder-volume[73051]: DEBUG cinder.volume.drivers.lvm [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Updating volume stats {{(pid=73051) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:57:54 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:54 devstack sudo[74039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:57:54 devstack sudo[74039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:55 devstack sudo[74039]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:55 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:55 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:55 devstack sudo[74042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:57:55 devstack sudo[74042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:55 devstack sudo[74042]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:55 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:55 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:55 devstack sudo[74050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:57:55 devstack sudo[74050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:56 devstack sudo[74050]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:56 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.505s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:56 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:56 devstack sudo[74053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:57:56 devstack sudo[74053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:56 devstack cinder-volume[72950]: DEBUG dbcounter [-] [72950] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72950) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 01:57:56 devstack sudo[74053]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:56 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.515s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:56 devstack cinder-volume[73051]: DEBUG cinder.manager [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Notifying Schedulers of capabilities ... {{(pid=73051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 01:57:56 devstack cinder-volume[73051]: INFO cinder.volume.manager [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Driver initialization completed successfully. Feb 27 01:57:56 devstack cinder-volume[73051]: INFO cinder.manager [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Initiating service 2 cleanup Feb 27 01:57:56 devstack cinder-volume[73051]: INFO cinder.manager [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Service 2 cleanup completed. Feb 27 01:57:56 devstack cinder-volume[73051]: DEBUG cinder.service [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Creating RPC server for service cinder-volume {{(pid=73051) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 01:57:56 devstack cinder-volume[73051]: DEBUG cinder.service [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73051) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 01:57:56 devstack cinder-volume[73051]: INFO cinder.volume.manager [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Feb 27 01:57:56 devstack cinder-volume[73051]: DEBUG cinder.volume.drivers.lvm [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Updating volume stats {{(pid=73051) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:57:56 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:56 devstack sudo[74059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:57:56 devstack sudo[74059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:57 devstack sudo[74059]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:57 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.514s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:57 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:57 devstack sudo[74119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:57:57 devstack sudo[74119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:57 devstack sudo[74119]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:57 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:57 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:57 devstack sudo[74122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:57:57 devstack sudo[74122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:58 devstack sudo[74122]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:58 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.451s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:58 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:58 devstack sudo[74125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:57:58 devstack sudo[74125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:58 devstack sudo[74125]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:58 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:58 devstack cinder-volume[73051]: INFO cinder.volume.manager [None req-7c65aa6a-5ef9-4ba1-a476-43acb04e4e10 None None] Driver post RPC initialization completed successfully. Feb 27 01:58:08 devstack cinder-volume[73051]: DEBUG dbcounter [-] [73051] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73051) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 01:58:08 devstack cinder-volume[73051]: DEBUG dbcounter [-] [73051] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=73051) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 01:59:03 devstack cinder-volume[73051]: DEBUG oslo_service.periodic_task [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 01:59:03 devstack cinder-volume[73051]: DEBUG cinder.volume.drivers.lvm [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Updating volume stats {{(pid=73051) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:59:03 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:59:03 devstack sudo[78014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:59:03 devstack sudo[78014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:59:04 devstack sudo[78014]: pam_unix(sudo:session): session closed for user root Feb 27 01:59:04 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:59:04 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:59:04 devstack sudo[78515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:59:04 devstack sudo[78515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:59:04 devstack sudo[78515]: pam_unix(sudo:session): session closed for user root Feb 27 01:59:04 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:59:04 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:59:04 devstack sudo[78973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:59:04 devstack sudo[78973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:59:05 devstack sudo[78973]: pam_unix(sudo:session): session closed for user root Feb 27 01:59:05 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.482s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:59:05 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:59:05 devstack sudo[79015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:59:05 devstack sudo[79015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:59:05 devstack sudo[79015]: pam_unix(sudo:session): session closed for user root Feb 27 01:59:05 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.494s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:59:05 devstack cinder-volume[73051]: DEBUG cinder.manager [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Notifying Schedulers of capabilities ... {{(pid=73051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:00:03 devstack cinder-volume[73051]: DEBUG oslo_service.periodic_task [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:00:03 devstack cinder-volume[73051]: DEBUG cinder.volume.drivers.lvm [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Updating volume stats {{(pid=73051) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 02:00:03 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:03 devstack sudo[79619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 02:00:03 devstack sudo[79619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:04 devstack sudo[79619]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:04 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:04 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:04 devstack sudo[79648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 02:00:04 devstack sudo[79648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:04 devstack sudo[79648]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:04 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:04 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:04 devstack sudo[79670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 02:00:04 devstack sudo[79670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:05 devstack sudo[79670]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:05 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.464s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:05 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:05 devstack sudo[79790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 02:00:05 devstack sudo[79790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:05 devstack sudo[79790]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:05 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:05 devstack cinder-volume[73051]: DEBUG cinder.manager [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Notifying Schedulers of capabilities ... {{(pid=73051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:00:08 devstack cinder-volume[73051]: DEBUG dbcounter [-] [73051] Writing DB stats cinder:SELECT=1 {{(pid=73051) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:00:08 devstack cinder-volume[73051]: DEBUG dbcounter [-] [73051] Writing DB stats cinder:UPDATE=1 {{(pid=73051) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:01:03 devstack cinder-volume[73051]: DEBUG oslo_service.periodic_task [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:01:03 devstack cinder-volume[73051]: DEBUG cinder.volume.drivers.lvm [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Updating volume stats {{(pid=73051) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 02:01:03 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:03 devstack sudo[81461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 02:01:03 devstack sudo[81461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:04 devstack sudo[81461]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:04 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.495s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:04 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:04 devstack sudo[81474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 02:01:04 devstack sudo[81474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:04 devstack sudo[81474]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:04 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.488s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:04 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:04 devstack sudo[81478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 02:01:04 devstack sudo[81478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:05 devstack sudo[81478]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:05 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.475s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:05 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:05 devstack sudo[81481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 02:01:05 devstack sudo[81481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:05 devstack sudo[81481]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:05 devstack cinder-volume[73051]: DEBUG oslo_concurrency.processutils [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.532s {{(pid=73051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:05 devstack cinder-volume[73051]: DEBUG cinder.manager [None req-31d9bd7f-dfb0-4566-b10d-dca49be8ce99 None None] Notifying Schedulers of capabilities ... {{(pid=73051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:01:40 devstack cinder-volume[72950]: INFO oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Caught SIGTERM, stopping children Feb 27 02:01:40 devstack cinder-volume[72950]: DEBUG oslo_concurrency.lockutils [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Acquiring lock "singleton_lock" {{(pid=72950) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:01:40 devstack cinder-volume[72950]: DEBUG oslo_concurrency.lockutils [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Acquired lock "singleton_lock" {{(pid=72950) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:01:40 devstack cinder-volume[72950]: DEBUG oslo_concurrency.lockutils [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Releasing lock "singleton_lock" {{(pid=72950) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:01:40 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Stop services. {{(pid=72950) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 27 02:01:40 devstack cinder-volume[72950]: DEBUG oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Killing children. {{(pid=72950) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 27 02:01:40 devstack cinder-volume[72950]: INFO oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Waiting on 1 children to exit Feb 27 02:01:41 devstack cinder-volume[73051]: DEBUG oslo_concurrency.lockutils [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Acquiring lock "singleton_lock" {{(pid=73051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:01:41 devstack cinder-volume[73051]: DEBUG oslo_concurrency.lockutils [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Acquired lock "singleton_lock" {{(pid=73051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:01:41 devstack cinder-volume[73051]: DEBUG oslo_concurrency.lockutils [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Releasing lock "singleton_lock" {{(pid=73051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:01:41 devstack cinder-volume[73051]: WARNING amqp [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 02:01:41 devstack cinder-volume[73051]: WARNING amqp [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 02:01:41 devstack cinder-volume[72950]: INFO oslo_service.backend._eventlet.service [None req-ac0e0f87-36d9-4ae7-bc6b-d0cc823a132a None None] Child 73051 exited with status 0 Feb 27 02:01:44 devstack cinder-volume[82265]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82265) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:01:44 devstack cinder-volume[82265]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82265) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:01:44 devstack cinder-volume[82265]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82265) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:01:45 devstack cinder-volume[82265]: INFO dbcounter [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Registered counter for database cinder Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_db.sqlalchemy.engines [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82265) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG dbcounter [-] [82265] Writer thread running {{(pid=82265) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 02:01:45 devstack cinder-volume[82265]: INFO cinder.rpc [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 02:01:45 devstack cinder-volume[82265]: INFO cinder.rpc [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_db.sqlalchemy.engines [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82265) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:01:45 devstack cinder-volume[82265]: INFO cinder.volume.manager [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Determined volume DB was empty at startup. Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG cinder.volume.manager [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82265) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 02:01:45 devstack cinder-volume[82265]: INFO cinder.volume.manager [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 27 02:01:45 devstack cinder-volume[82265]: WARNING stevedore.named [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 02:01:45 devstack cinder-volume[82265]: WARNING castellan.key_manager [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 02:01:45 devstack cinder-volume[82265]: WARNING cinder.keymgr.conf_key_mgr [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 02:01:45 devstack cinder-volume[82265]: INFO cinder.volume.manager [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_db.sqlalchemy.engines [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82265) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:01:45 devstack cinder-volume[82265]: INFO oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Starting 1 workers Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Started child 82384 {{(pid=82265) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Full set of CONF: {{(pid=82265) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] ******************************************************************************** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Configuration options gathered from: {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] ================================================================================ {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] allow_availability_zone_fallback = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] allow_compression_on_image_upload = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] allowed_direct_url_schemes = [] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] api_rate_limit = True {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] auth_strategy = keystone {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_availability_zone = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_host = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_name = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_stats_polling_interval = 60 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backup_api_class = cinder.backup.api.API {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backup_name_template = backup-%s {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backup_use_same_host = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backup_use_temp_snapshot = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] chap_password = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] chap_username = {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cinder_internal_tenant_project_id = e3e7d66eb6554aa5b76e1418922cc5d5 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cinder_internal_tenant_user_id = 33f3405778cb4385858d6011405af76a {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cluster = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] compression_format = gzip {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] compute_api_class = cinder.compute.nova.API {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] config_dir = [] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] config_source = [] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] control_exchange = openstack {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] debug = True {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] default_availability_zone = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] default_group_type = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82384]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] default_volume_type = QuobyteHD {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] disk_geometry = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] driver_client_cert = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] driver_client_cert_key = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] driver_data_namespace = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] driver_ssl_cert_path = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] driver_ssl_cert_verify = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] driver_use_ssl = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] enable_new_services = True {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] enable_unsupported_driver = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] enabled_backends = ['QuobyteHD'] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] enforce_multipath_for_image_xfer = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] filter_function = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] glance_api_insecure = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] glance_api_servers = ['http://192.168.122.23/image'] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] glance_api_ssl_compression = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] glance_ca_certificates_file = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] glance_catalog_info = image:glance:publicURL {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] glance_certfile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] glance_keyfile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] glance_num_retries = 3 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] glance_request_timeout = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] goodness_function = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] graceful_shutdown_timeout = 5 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] group_api_class = cinder.group.api.API {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] host = devstack {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] image_compress_on_upload = True {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] image_conversion_address_space_limit = 1 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] image_conversion_cpu_limit = 60 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] image_conversion_disable = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] image_upload_use_cinder_backend = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] image_upload_use_internal_tenant = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] image_volume_cache_enabled = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] image_volume_cache_max_count = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] image_volume_cache_max_size_gb = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] init_host_max_objects_retrieval = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] instance_format = [instance: %(uuid)s] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] iscsi_target_flags = {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] iscsi_write_cache = on {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] iser_helper = tgtadm {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] iser_ip_address = 192.168.122.23 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] iser_port = 3260 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] log_color = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] log_config_append = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] log_dir = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] log_file = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] log_options = True {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] log_rotate_interval = 1 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] log_rotate_interval_type = days {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] log_rotation_type = none {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] max_age = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] max_logfile_count = 30 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] max_logfile_size_mb = 200 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] max_over_subscription_ratio = 20.0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] message_reap_interval = 86400 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] message_ttl = 2592000 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] migration_create_volume_timeout_secs = 300 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] monkey_patch = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] monkey_patch_modules = [] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] my_ip = 192.168.122.23 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] no_snapshot_gb_quota = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] num_iser_scan_tries = 3 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] num_shell_tries = 3 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] num_volume_device_scan_tries = 3 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] nvmeof_conn_info_version = 1 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] nvmet_ns_id = 10 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] nvmet_port_id = 1 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] osapi_max_limit = 1000 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] osapi_volume_ext_list = [] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] osapi_volume_listen = 0.0.0.0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] osapi_volume_listen_port = 8776 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] osapi_volume_use_ssl = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] osapi_volume_workers = 2 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] per_volume_size_limit = -1 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] periodic_fuzzy_delay = 60 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] periodic_interval = 60 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] project_id_regex = [0-9a-f\-]+ {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] public_endpoint = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] publish_errors = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] quota_backup_gigabytes = 1000 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] quota_backups = 10 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] quota_gigabytes = 1000 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] quota_groups = 10 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] quota_snapshots = 10 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] quota_volumes = 10 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] rate_limit_burst = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] rate_limit_except_level = CRITICAL {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] rate_limit_interval = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] reinit_driver_count = 3 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] replication_device = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] report_discard_supported = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] report_interval = 120 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] reservation_clean_interval = 86400 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] reservation_expire = 86400 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] reserved_image_namespaces = [] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] reserved_percentage = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] rpc_response_timeout = 120 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] run_external_periodic_tasks = True {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] scst_target_driver = iscsi {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] scst_target_iqn_name = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] service_down_time = 720 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] shell_completion = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] snapshot_name_template = snapshot-%s {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] split_loggers = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] state_path = /opt/stack/data/cinder {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] storage_availability_zone = nova {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] storage_protocol = iSCSI {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] syslog_log_facility = LOG_USER {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] target_helper = lioadm {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] target_ip_address = 192.168.122.23 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] target_port = 3260 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] target_protocol = iscsi {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] target_secondary_ip_addresses = [] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] trace_flags = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] transfer_api_class = cinder.transfer.api.API {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] transport_url = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] until_refresh = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] use_chap_auth = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] use_default_quota_class = True {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] use_journal = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] use_json = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] use_multipath_for_image_xfer = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] use_stderr = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] use_syslog = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] verify_glance_signatures = enabled {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] volume_api_class = cinder.volume.api.API {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] volume_backend_name = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] volume_clear = zero {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] volume_clear_ionice = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] volume_clear_size = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] volume_copy_bps_limit = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] volume_dd_blocksize = 1M {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] volume_name_template = volume-%s {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] volume_service_inithost_offload = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] volume_usage_audit_period = month {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] zoning_mode = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_concurrency.disable_process_locking = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.admin_password = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.admin_token = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.admin_user = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.auth_admin_prefix = {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.auth_port = 35357 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.auth_protocol = https {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.auth_section = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.auth_type = password {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.auth_uri = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.auth_version = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.cache = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.certfile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.delay_auth_decision = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.http_connect_timeout = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.identity_uri = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.include_service_catalog = True {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.insecure = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.interface = public {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.keyfile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.memcache_password = {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.memcache_username = {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.region_name = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.service_token_roles_required = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.service_type = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.token_cache_time = 300 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.23/identity {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.backend = dogpile.cache.null {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.backend_argument = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.backend_expiration_time = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.config_prefix = cache.oslo {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.debug_cache_backend = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.enable_retry_client = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.enable_socket_keepalive = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.enabled = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.enforce_fips_mode = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.expiration_time = 600 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.hashclient_retry_attempts = 2 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.memcache_dead_retry = 300 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.memcache_pool_maxsize = 10 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.memcache_sasl_enabled = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.password = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.proxies = [] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.redis_db = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.redis_sentinel_service_name = mymaster {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.redis_server = localhost:6379 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.retry_attempts = 2 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.retry_delay = 0.0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.socket_keepalive_count = 1 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.socket_keepalive_idle = 1 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.socket_keepalive_interval = 1 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.socket_timeout = 1.0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.tls_allowed_ciphers = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.tls_cafile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.tls_certfile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.tls_enabled = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.tls_keyfile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cache.username = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] coordination.backend_url = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.asyncio_connection = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.asyncio_slave_connection = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.backend = sqlalchemy {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.connection = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.connection_debug = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.connection_parameters = {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.connection_recycle_time = 3600 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.connection_trace = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.db_inc_retry_interval = True {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.db_max_retries = 20 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.db_max_retry_interval = 10 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.db_retry_interval = 1 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.max_overflow = 50 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.max_pool_size = 5 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.max_retries = 10 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.mysql_wsrep_sync_wait = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.pool_timeout = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.retry_interval = 10 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.slave_connection = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.sqlite_synchronous = True {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.synchronous_reader = True {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] database.use_db_reconnect = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] profiler.connection_string = messaging:// {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] profiler.enabled = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] profiler.es_doc_type = notification {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] profiler.es_scroll_size = 10000 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] profiler.es_scroll_time = 2m {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] profiler.filter_error_trace = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] profiler.hmac_keys = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] profiler.sentinel_service_name = mymaster {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] profiler.socket_timeout = 0.1 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] profiler.trace_requests = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] profiler.trace_sqlalchemy = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] profiler_jaeger.process_tags = {} {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] profiler_jaeger.service_name_prefix = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] profiler_otlp.service_name_prefix = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_policy.enforce_new_defaults = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82384]: INFO cinder.volume.manager [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Starting volume driver QuobyteDriver (1.1.14) Feb 27 02:01:45 devstack cinder-volume[82265]: WARNING oslo_config.cfg [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_policy.enforce_scope = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_policy.policy_default_rule = default {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_policy.policy_file = policy.yaml {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_policy.remote_timeout = 60.0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82384]: DEBUG cinder.volume.drivers.remotefs [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82384) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] privsep_osbrick.group = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] privsep_osbrick.helper_command = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] privsep_osbrick.user = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cinder_sys_admin.group = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cinder_sys_admin.helper_command = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] cinder_sys_admin.user = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] service_user.auth_section = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] service_user.auth_type = password {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] service_user.cafile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] service_user.certfile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] service_user.collect_timing = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] service_user.insecure = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] service_user.keyfile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] service_user.send_service_user_token = True {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] service_user.split_loggers = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] service_user.timeout = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] glance.auth_section = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] glance.auth_type = password {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] glance.certfile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] glance.collect_timing = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] glance.insecure = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] glance.keyfile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] glance.region_name = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] glance.split_loggers = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] glance.timeout = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.backend_availability_zone = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.chap_password = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.chap_username = {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.disk_geometry = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.driver_client_cert = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.driver_client_cert_key = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.driver_data_namespace = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.driver_use_ssl = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.enable_unsupported_driver = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.extra_capabilities = {} {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.filter_function = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.goodness_function = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.iscsi_target_flags = {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.iscsi_write_cache = on {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.iser_helper = tgtadm {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.iser_ip_address = 192.168.122.23 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.iser_port = 3260 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.nas_host = {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.nas_login = admin {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.nas_mount_options = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.nas_password = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.nas_private_key = {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.nas_share_path = {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.nas_ssh_port = 22 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.num_shell_tries = 3 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.nvmet_port_id = 1 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.quobyte_client_cfg = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.quobyte_volume_url = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.replication_device = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.report_discard_supported = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.reserved_percentage = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.scst_target_driver = iscsi {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.scst_target_iqn_name = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.storage_protocol = iSCSI {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.target_helper = tgtadm {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.target_ip_address = 192.168.122.23 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.target_port = 3260 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.target_protocol = iscsi {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.trace_flags = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.unique_fqdn_network = True {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.use_chap_auth = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.volume_backend_name = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.volume_clear = zero {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.volume_clear_ionice = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.volume_clear_size = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_reports.file_event_handler = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_reports.log_dir = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.backend_availability_zone = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.backend_host = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.chap_password = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.chap_username = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.chiscsi_conf = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.disk_geometry = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.driver_client_cert = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.driver_client_cert_key = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.driver_data_namespace = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.driver_use_ssl = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.extra_capabilities = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.filter_function = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.goodness_function = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.iscsi_target_flags = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.iscsi_write_cache = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.iser_helper = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.iser_ip_address = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.iser_port = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.iser_target_prefix = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.nas_host = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.nas_login = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.nas_mount_options = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.nas_password = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.nas_private_key = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.nas_share_path = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.nas_ssh_port = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.num_shell_tries = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.nvmet_ns_id = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.nvmet_port_id = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.replication_device = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.report_discard_supported = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.reserved_percentage = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.scst_target_driver = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.storage_protocol = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.target_helper = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.target_ip_address = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.target_port = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.target_prefix = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.target_protocol = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.trace_flags = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.unique_fqdn_network = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.use_chap_auth = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.volume_clear = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.volume_clear_ionice = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.volume_clear_size = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] QuobyteHD.volumes_dir = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.ssl = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.ssl_version = {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_notifications.driver = [] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_notifications.retry = -1 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] oslo_messaging_notifications.transport_url = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] key_manager.fixed_key = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican.barbican_api_version = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican.barbican_endpoint = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican.barbican_endpoint_type = public {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican.barbican_region_name = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican.cafile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican.certfile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican.collect_timing = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican.insecure = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican.keyfile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican.number_of_retries = 60 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican.retry_delay = 1 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican.send_service_user_token = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican.split_loggers = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican.timeout = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican.verify_ssl = True {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican.verify_ssl_path = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican_service_user.auth_section = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican_service_user.auth_type = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican_service_user.cafile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican_service_user.certfile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican_service_user.collect_timing = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican_service_user.insecure = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican_service_user.keyfile = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican_service_user.split_loggers = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] barbican_service_user.timeout = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] vault.approle_role_id = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] vault.approle_secret_id = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] vault.kv_mountpoint = secret {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] vault.kv_path = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] vault.kv_version = 2 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] vault.namespace = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] vault.root_token_id = **** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] vault.ssl_ca_crt_file = None {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] vault.timeout = 60.0 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] vault.use_ssl = False {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:45 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] ******************************************************************************** {{(pid=82265) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 02:01:45 devstack cinder-volume[82384]: DEBUG cinder.volume.drivers.quobyte [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82384) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 27 02:01:45 devstack cinder-volume[82384]: WARNING cinder.volume.drivers.quobyte [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 27 02:01:45 devstack cinder-volume[82384]: WARNING cinder.volume.drivers.quobyte [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 27 02:01:45 devstack cinder-volume[82384]: DEBUG oslo_concurrency.processutils [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Running cmd (subprocess): mount.quobyte {{(pid=82384) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:45 devstack quobyte-client[82385]: Reading configuration file: /etc/quobyte/client.cfg Feb 27 02:01:45 devstack quobyte-client[82385]: Invalid parameters found, error: missing mount point. Feb 27 02:01:45 devstack quobyte-client[82385]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 27 02:01:45 devstack quobyte-client[82385]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 27 02:01:45 devstack cinder-volume[82384]: DEBUG oslo_concurrency.processutils [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] CMD "mount.quobyte" returned: 1 in 0.067s {{(pid=82384) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:45 devstack cinder-volume[82384]: DEBUG oslo_concurrency.lockutils [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82384) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:45 devstack cinder-volume[82384]: DEBUG oslo_concurrency.lockutils [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82384) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:45 devstack cinder-volume[82384]: DEBUG cinder.volume.drivers.quobyte [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:01:45 devstack cinder-volume[82384]: INFO cinder.volume.drivers.quobyte [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf ... Feb 27 02:01:45 devstack cinder-volume[82384]: DEBUG oslo_concurrency.processutils [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec -c /etc/quobyte/client-cinder.cfg {{(pid=82384) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:45 devstack sudo[82386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec -c /etc/quobyte/client-cinder.cfg Feb 27 02:01:45 devstack sudo[82386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:46 devstack sudo[82386]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:46 devstack cinder-volume[82384]: DEBUG oslo_concurrency.processutils [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.554s {{(pid=82384) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:46 devstack cinder-volume[82384]: INFO cinder.volume.drivers.quobyte [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf succeeded Feb 27 02:01:46 devstack cinder-volume[82384]: DEBUG cinder.volume.drivers.quobyte [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:01:46 devstack cinder-volume[82384]: DEBUG oslo_concurrency.lockutils [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.563s {{(pid=82384) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:46 devstack cinder-volume[82384]: DEBUG oslo_concurrency.processutils [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82384) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:46 devstack sudo[82456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:01:46 devstack sudo[82456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:46 devstack sudo[82456]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:46 devstack cinder-volume[82384]: DEBUG oslo_concurrency.processutils [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.488s {{(pid=82384) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:46 devstack cinder-volume[82384]: INFO cinder.volume.driver [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Driver hasn't implemented _init_vendor_properties() Feb 27 02:01:46 devstack cinder-volume[82384]: DEBUG cinder.volume.driver [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82384) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 02:01:46 devstack cinder-volume[82384]: DEBUG oslo_db.sqlalchemy.engines [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82384) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:01:46 devstack cinder-volume[82384]: DEBUG dbcounter [-] [82384] Writer thread running {{(pid=82384) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 02:01:46 devstack cinder-volume[82384]: DEBUG cinder.db.sqlalchemy.api [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Building query based on filter {{(pid=82384) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 02:01:46 devstack cinder-volume[82384]: DEBUG cinder.image.image_utils [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82384) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 02:01:46 devstack cinder-volume[82384]: INFO cinder.keymgr.migration [None req-68934483-4586-4b87-919e-920006855f7e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 02:01:46 devstack cinder-volume[82384]: DEBUG oslo_concurrency.lockutils [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82384) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:46 devstack cinder-volume[82384]: DEBUG oslo_concurrency.lockutils [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82384) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:46 devstack cinder-volume[82384]: DEBUG cinder.volume.drivers.quobyte [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:01:46 devstack cinder-volume[82384]: DEBUG cinder.volume.drivers.quobyte [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:01:46 devstack cinder-volume[82384]: DEBUG oslo_concurrency.lockutils [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82384) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:46 devstack cinder-volume[82384]: DEBUG oslo_concurrency.processutils [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82384) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:46 devstack sudo[82461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:01:46 devstack sudo[82461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:47 devstack sudo[82461]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:47 devstack cinder-volume[82384]: DEBUG oslo_concurrency.processutils [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.471s {{(pid=82384) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:47 devstack cinder-volume[82384]: DEBUG cinder.manager [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Notifying Schedulers of capabilities ... {{(pid=82384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:01:47 devstack cinder-volume[82384]: INFO cinder.volume.manager [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Driver initialization completed successfully. Feb 27 02:01:47 devstack cinder-volume[82384]: INFO cinder.manager [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Initiating service 3 cleanup Feb 27 02:01:47 devstack cinder-volume[82384]: INFO cinder.manager [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Service 3 cleanup completed. Feb 27 02:01:47 devstack cinder-volume[82384]: DEBUG cinder.service [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Creating RPC server for service cinder-volume {{(pid=82384) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 02:01:47 devstack cinder-volume[82384]: DEBUG cinder.service [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82384) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 02:01:47 devstack cinder-volume[82384]: INFO cinder.volume.manager [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 27 02:01:47 devstack cinder-volume[82384]: DEBUG oslo_concurrency.lockutils [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82384) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:47 devstack cinder-volume[82384]: DEBUG oslo_concurrency.lockutils [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82384) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:47 devstack cinder-volume[82384]: DEBUG cinder.volume.drivers.quobyte [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:01:47 devstack cinder-volume[82384]: DEBUG cinder.volume.drivers.quobyte [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:01:47 devstack cinder-volume[82384]: DEBUG oslo_concurrency.lockutils [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82384) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:47 devstack cinder-volume[82384]: DEBUG oslo_concurrency.processutils [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82384) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:47 devstack sudo[82466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:01:47 devstack sudo[82466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:47 devstack sudo[82466]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:47 devstack cinder-volume[82384]: DEBUG oslo_concurrency.processutils [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.541s {{(pid=82384) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:47 devstack cinder-volume[82384]: INFO cinder.volume.manager [None req-d0082b87-ed35-4603-8b83-7fd30054d58d None None] Driver post RPC initialization completed successfully. Feb 27 02:01:50 devstack cinder-volume[82384]: DEBUG oslo_concurrency.lockutils [None req-e5626be3-be73-4e1c-b499-ba97d0f48a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82384) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:50 devstack cinder-volume[82384]: DEBUG oslo_concurrency.lockutils [None req-e5626be3-be73-4e1c-b499-ba97d0f48a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82384) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:50 devstack cinder-volume[82384]: DEBUG cinder.volume.drivers.quobyte [None req-e5626be3-be73-4e1c-b499-ba97d0f48a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82384) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:01:50 devstack cinder-volume[82384]: DEBUG cinder.volume.drivers.quobyte [None req-e5626be3-be73-4e1c-b499-ba97d0f48a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82384) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:01:50 devstack cinder-volume[82384]: DEBUG oslo_concurrency.lockutils [None req-e5626be3-be73-4e1c-b499-ba97d0f48a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82384) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:50 devstack cinder-volume[82384]: DEBUG oslo_concurrency.processutils [None req-e5626be3-be73-4e1c-b499-ba97d0f48a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82384) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:50 devstack sudo[82530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:01:50 devstack sudo[82530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:51 devstack sudo[82530]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:51 devstack cinder-volume[82384]: DEBUG oslo_concurrency.processutils [None req-e5626be3-be73-4e1c-b499-ba97d0f48a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.414s {{(pid=82384) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:51 devstack cinder-volume[82384]: DEBUG cinder.manager [None req-e5626be3-be73-4e1c-b499-ba97d0f48a50 None None] Notifying Schedulers of capabilities ... {{(pid=82384) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:01:54 devstack cinder-volume[82265]: INFO oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Caught SIGTERM, stopping children Feb 27 02:01:54 devstack cinder-volume[82265]: DEBUG oslo_concurrency.lockutils [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Acquiring lock "singleton_lock" {{(pid=82265) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:01:54 devstack cinder-volume[82265]: DEBUG oslo_concurrency.lockutils [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Acquired lock "singleton_lock" {{(pid=82265) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:01:54 devstack cinder-volume[82265]: DEBUG oslo_concurrency.lockutils [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Releasing lock "singleton_lock" {{(pid=82265) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:01:54 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Stop services. {{(pid=82265) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 27 02:01:54 devstack cinder-volume[82265]: DEBUG oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Killing children. {{(pid=82265) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 27 02:01:54 devstack cinder-volume[82265]: INFO oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Waiting on 1 children to exit Feb 27 02:01:55 devstack cinder-volume[82384]: DEBUG oslo_concurrency.lockutils [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Acquiring lock "singleton_lock" {{(pid=82384) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:01:55 devstack cinder-volume[82384]: DEBUG oslo_concurrency.lockutils [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Acquired lock "singleton_lock" {{(pid=82384) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:01:55 devstack cinder-volume[82384]: DEBUG oslo_concurrency.lockutils [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Releasing lock "singleton_lock" {{(pid=82384) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:01:55 devstack cinder-volume[82384]: WARNING amqp [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 02:01:55 devstack cinder-volume[82384]: WARNING amqp [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 02:01:55 devstack cinder-volume[82265]: INFO oslo_service.backend._eventlet.service [None req-16601049-3a28-4c46-9d50-86d4d332e27d None None] Child 82384 exited with status 0 Feb 27 02:01:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82600) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:01:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82600) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:01:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82600) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:01:58 devstack cinder-volume[82600]: INFO dbcounter [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] Registered counter for database cinder Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_db.sqlalchemy.engines [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82600) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writer thread running {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 02:01:58 devstack cinder-volume[82600]: INFO cinder.rpc [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 02:01:58 devstack cinder-volume[82600]: INFO cinder.rpc [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_db.sqlalchemy.engines [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82600) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:01:58 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] Determined volume DB was empty at startup. Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82600) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 02:01:58 devstack cinder-volume[82600]: WARNING stevedore.named [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 02:01:58 devstack cinder-volume[82600]: WARNING castellan.key_manager [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 02:01:58 devstack cinder-volume[82600]: WARNING cinder.keymgr.conf_key_mgr [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 02:01:58 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_db.sqlalchemy.engines [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82600) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:01:58 devstack cinder-volume[82600]: INFO oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] Starting 1 workers Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] Started child 82738 {{(pid=82600) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] Full set of CONF: {{(pid=82600) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] ******************************************************************************** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] Configuration options gathered from: {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] ================================================================================ {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] allow_availability_zone_fallback = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] allow_compression_on_image_upload = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] allowed_direct_url_schemes = [] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] api_rate_limit = True {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] auth_strategy = keystone {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_availability_zone = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_host = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_name = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_stats_polling_interval = 60 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backup_api_class = cinder.backup.api.API {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backup_name_template = backup-%s {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backup_use_same_host = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backup_use_temp_snapshot = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] chap_password = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] chap_username = {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cinder_internal_tenant_project_id = e3e7d66eb6554aa5b76e1418922cc5d5 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cinder_internal_tenant_user_id = 33f3405778cb4385858d6011405af76a {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cluster = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] compression_format = gzip {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] compute_api_class = cinder.compute.nova.API {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] config_dir = [] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] config_source = [] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] control_exchange = openstack {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] debug = True {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] default_availability_zone = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] default_group_type = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] default_volume_type = QuobyteHD {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] disk_geometry = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] driver_client_cert = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] driver_client_cert_key = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] driver_data_namespace = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] driver_ssl_cert_path = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] driver_ssl_cert_verify = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] driver_use_ssl = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] enable_new_services = True {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] enable_unsupported_driver = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] enabled_backends = ['QuobyteHD'] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] enforce_multipath_for_image_xfer = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] filter_function = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82738]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] glance_api_insecure = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] glance_api_servers = ['http://192.168.122.23/image'] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] glance_api_ssl_compression = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] glance_ca_certificates_file = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] glance_catalog_info = image:glance:publicURL {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] glance_certfile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] glance_keyfile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] glance_num_retries = 3 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] glance_request_timeout = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] goodness_function = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] graceful_shutdown_timeout = 5 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] group_api_class = cinder.group.api.API {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] host = devstack {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] image_compress_on_upload = True {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] image_conversion_address_space_limit = 1 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] image_conversion_cpu_limit = 60 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] image_conversion_disable = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] image_upload_use_cinder_backend = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] image_upload_use_internal_tenant = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] image_volume_cache_enabled = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] image_volume_cache_max_count = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] image_volume_cache_max_size_gb = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] init_host_max_objects_retrieval = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] instance_format = [instance: %(uuid)s] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] iscsi_target_flags = {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] iscsi_write_cache = on {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] iser_helper = tgtadm {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:58 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] iser_ip_address = 192.168.122.23 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] iser_port = 3260 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] log_color = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] log_config_append = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] log_dir = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] log_file = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] log_options = True {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] log_rotate_interval = 1 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] log_rotate_interval_type = days {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] log_rotation_type = none {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] max_age = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] max_logfile_count = 30 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] max_logfile_size_mb = 200 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] max_over_subscription_ratio = 20.0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] message_reap_interval = 86400 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] message_ttl = 2592000 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] migration_create_volume_timeout_secs = 300 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] monkey_patch = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] monkey_patch_modules = [] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] my_ip = 192.168.122.23 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] no_snapshot_gb_quota = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] num_iser_scan_tries = 3 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] num_shell_tries = 3 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] num_volume_device_scan_tries = 3 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] nvmeof_conn_info_version = 1 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] nvmet_ns_id = 10 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] nvmet_port_id = 1 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] osapi_max_limit = 1000 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] osapi_volume_ext_list = [] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] osapi_volume_listen_port = 8776 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] osapi_volume_use_ssl = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] osapi_volume_workers = 2 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] per_volume_size_limit = -1 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] periodic_fuzzy_delay = 60 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] periodic_interval = 60 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] public_endpoint = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] publish_errors = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] quota_backup_gigabytes = 1000 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] quota_backups = 10 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] quota_gigabytes = 1000 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] quota_groups = 10 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] quota_snapshots = 10 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] quota_volumes = 10 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] rate_limit_burst = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] rate_limit_except_level = CRITICAL {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] rate_limit_interval = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] reinit_driver_count = 3 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] replication_device = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] report_discard_supported = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] report_interval = 120 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] reservation_clean_interval = 86400 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] reservation_expire = 86400 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] reserved_image_namespaces = [] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] reserved_percentage = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] rpc_response_timeout = 120 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] run_external_periodic_tasks = True {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] scst_target_driver = iscsi {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] scst_target_iqn_name = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] service_down_time = 720 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] shell_completion = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] snapshot_name_template = snapshot-%s {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] split_loggers = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] state_path = /opt/stack/data/cinder {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] storage_availability_zone = nova {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] storage_protocol = iSCSI {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] syslog_log_facility = LOG_USER {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] target_helper = lioadm {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] target_ip_address = 192.168.122.23 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] target_port = 3260 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Starting volume driver QuobyteDriver (1.1.14) Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82738) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] target_protocol = iscsi {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] target_secondary_ip_addresses = [] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] trace_flags = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] transport_url = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] until_refresh = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] use_chap_auth = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] use_default_quota_class = True {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] use_journal = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] use_json = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] use_multipath_for_image_xfer = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] use_stderr = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] use_syslog = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] verify_glance_signatures = enabled {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] volume_api_class = cinder.volume.api.API {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] volume_backend_name = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] volume_clear = zero {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] volume_clear_ionice = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] volume_clear_size = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] volume_copy_bps_limit = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] volume_dd_blocksize = 1M {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] volume_name_template = volume-%s {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] volume_service_inithost_offload = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] volume_usage_audit_period = month {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] zoning_mode = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_concurrency.disable_process_locking = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.admin_password = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.admin_token = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.admin_user = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.auth_port = 35357 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.auth_protocol = https {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.auth_section = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.auth_type = password {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.auth_uri = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.auth_version = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.cache = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.certfile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.identity_uri = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.include_service_catalog = True {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.insecure = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.interface = public {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.keyfile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.memcache_password = {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.memcache_username = {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.region_name = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.service_type = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.23/identity {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.backend = dogpile.cache.null {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.backend_argument = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.backend_expiration_time = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.config_prefix = cache.oslo {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.debug_cache_backend = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.enable_retry_client = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.enable_socket_keepalive = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.enabled = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.enforce_fips_mode = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.expiration_time = 600 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.hashclient_retry_attempts = 2 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.memcache_dead_retry = 300 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.memcache_pool_maxsize = 10 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.memcache_sasl_enabled = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.password = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82738) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 27 02:01:59 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.quobyte [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 27 02:01:59 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.quobyte [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.proxies = [] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.redis_db = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.redis_server = localhost:6379 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.retry_attempts = 2 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.retry_delay = 0.0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.socket_keepalive_count = 1 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.socket_keepalive_idle = 1 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.socket_keepalive_interval = 1 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.socket_timeout = 1.0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.tls_allowed_ciphers = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.tls_cafile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Running cmd (subprocess): mount.quobyte {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.tls_certfile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.tls_enabled = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.tls_keyfile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cache.username = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] coordination.backend_url = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.asyncio_connection = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.asyncio_slave_connection = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.backend = sqlalchemy {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.connection = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.connection_debug = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.connection_parameters = {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.connection_recycle_time = 3600 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.connection_trace = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.db_inc_retry_interval = True {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.db_max_retries = 20 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.db_max_retry_interval = 10 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.db_retry_interval = 1 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.max_overflow = 50 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.max_pool_size = 5 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.max_retries = 10 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.mysql_wsrep_sync_wait = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.pool_timeout = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.retry_interval = 10 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.slave_connection = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.sqlite_synchronous = True {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.synchronous_reader = True {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] database.use_db_reconnect = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] profiler.connection_string = messaging:// {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] profiler.enabled = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] profiler.es_doc_type = notification {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] profiler.es_scroll_size = 10000 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] profiler.es_scroll_time = 2m {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] profiler.filter_error_trace = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] profiler.hmac_keys = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] profiler.sentinel_service_name = mymaster {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] profiler.socket_timeout = 0.1 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] profiler.trace_requests = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] profiler.trace_sqlalchemy = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] profiler_jaeger.process_tags = {} {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] profiler_jaeger.service_name_prefix = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] profiler_otlp.service_name_prefix = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_policy.enforce_new_defaults = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: WARNING oslo_config.cfg [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_policy.enforce_scope = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_policy.policy_default_rule = default {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_policy.policy_file = policy.yaml {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] privsep_osbrick.group = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] privsep_osbrick.helper_command = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] privsep_osbrick.user = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cinder_sys_admin.group = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cinder_sys_admin.helper_command = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] cinder_sys_admin.user = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] service_user.auth_section = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] service_user.auth_type = password {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] service_user.cafile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] service_user.certfile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] service_user.collect_timing = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] service_user.insecure = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] service_user.keyfile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] service_user.send_service_user_token = True {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] service_user.split_loggers = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] service_user.timeout = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] glance.auth_section = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] glance.auth_type = password {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] glance.certfile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] glance.collect_timing = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] glance.insecure = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] glance.keyfile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] glance.region_name = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] glance.split_loggers = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] glance.timeout = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.backend_availability_zone = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.chap_password = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.chap_username = {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.disk_geometry = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.driver_client_cert = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.driver_client_cert_key = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.driver_data_namespace = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.driver_use_ssl = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.extra_capabilities = {} {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.filter_function = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.goodness_function = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.iscsi_target_flags = {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.iscsi_write_cache = on {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.iser_helper = tgtadm {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.iser_ip_address = 192.168.122.23 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.iser_port = 3260 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.nas_host = {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.nas_login = admin {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.nas_mount_options = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.nas_password = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.nas_private_key = {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.nas_share_path = {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.num_shell_tries = 3 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack quobyte-client[82751]: Reading configuration file: /etc/quobyte/client.cfg Feb 27 02:01:59 devstack quobyte-client[82751]: Invalid parameters found, error: missing mount point. Feb 27 02:01:59 devstack quobyte-client[82751]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 27 02:01:59 devstack quobyte-client[82751]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.quobyte_volume_url = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.replication_device = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] CMD "mount.quobyte" returned: 1 in 0.108s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.report_discard_supported = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.reserved_percentage = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.target_helper = tgtadm {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.target_ip_address = 192.168.122.23 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.target_port = 3260 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.target_protocol = iscsi {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.trace_flags = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.unique_fqdn_network = True {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.use_chap_auth = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.volume_backend_name = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.volume_clear = zero {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.volume_clear_ionice = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.volume_clear_size = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_reports.file_event_handler = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_reports.log_dir = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.backend_availability_zone = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.backend_host = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.chap_password = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.chap_username = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.chiscsi_conf = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.disk_geometry = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.driver_client_cert = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.driver_data_namespace = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.driver_use_ssl = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack sudo[82771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.extra_capabilities = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack sudo[82771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.filter_function = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.goodness_function = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.iser_helper = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.iser_ip_address = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.iser_port = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.iser_target_prefix = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.nas_host = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.nas_login = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.nas_mount_options = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.nas_password = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.nas_private_key = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.nas_share_path = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.nas_ssh_port = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.num_shell_tries = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.nvmet_port_id = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.replication_device = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.report_discard_supported = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.reserved_percentage = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.scst_target_driver = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.storage_protocol = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.target_helper = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.target_ip_address = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.target_port = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.target_prefix = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.target_protocol = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.trace_flags = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.use_chap_auth = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.volume_clear = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.volume_clear_size = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] QuobyteHD.volumes_dir = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.ssl = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_notifications.driver = [] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_notifications.retry = -1 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] key_manager.fixed_key = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican.barbican_api_version = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican.barbican_endpoint = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican.barbican_endpoint_type = public {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican.barbican_region_name = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican.cafile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican.certfile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican.collect_timing = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican.insecure = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican.keyfile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican.number_of_retries = 60 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican.retry_delay = 1 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican.send_service_user_token = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican.split_loggers = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican.timeout = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican.verify_ssl = True {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican.verify_ssl_path = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican_service_user.auth_section = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican_service_user.auth_type = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican_service_user.cafile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican_service_user.certfile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican_service_user.collect_timing = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican_service_user.insecure = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican_service_user.keyfile = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican_service_user.split_loggers = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] barbican_service_user.timeout = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] vault.approle_role_id = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] vault.approle_secret_id = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] vault.kv_mountpoint = secret {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] vault.kv_path = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] vault.kv_version = 2 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] vault.namespace = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] vault.root_token_id = **** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] vault.ssl_ca_crt_file = None {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] vault.timeout = 60.0 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] vault.use_ssl = False {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:01:59 devstack cinder-volume[82600]: DEBUG oslo_service.backend._eventlet.service [None req-bb9e9c29-fbb5-49ad-b910-0c22d01ae1f8 None None] ******************************************************************************** {{(pid=82600) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 02:01:59 devstack sudo[82771]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.550s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:59 devstack cinder-volume[82738]: INFO cinder.volume.driver [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Driver hasn't implemented _init_vendor_properties() Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG cinder.volume.driver [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82738) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG oslo_db.sqlalchemy.engines [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82738) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writer thread running {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG cinder.db.sqlalchemy.api [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Building query based on filter {{(pid=82738) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82738) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:59 devstack cinder-volume[82738]: INFO cinder.keymgr.migration [None req-7a1e3777-641d-4521-b490-bb212d7a3d2a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 02:01:59 devstack sudo[82815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:01:59 devstack sudo[82815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:01 devstack sudo[82815]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 1.064s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:01 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:01 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Driver initialization completed successfully. Feb 27 02:02:01 devstack cinder-volume[82738]: INFO cinder.manager [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Initiating service 3 cleanup Feb 27 02:02:01 devstack cinder-volume[82738]: INFO cinder.manager [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Service 3 cleanup completed. Feb 27 02:02:01 devstack cinder-volume[82738]: DEBUG cinder.service [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Creating RPC server for service cinder-volume {{(pid=82738) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 02:02:01 devstack cinder-volume[82738]: DEBUG cinder.service [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82738) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 02:02:01 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 27 02:02:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:01 devstack sudo[82858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:02:01 devstack sudo[82858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:01 devstack sudo[82858]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.532s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:01 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-b5e3283d-44b3-4aa7-bd1a-26c0253b1d7b None None] Driver post RPC initialization completed successfully. Feb 27 02:02:08 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:02:11 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:02:11 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=4 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:03:01 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-9ae8b7fb-b9f8-4a73-b4b5-ece7cc13528f tempest-GroupsTest-671880004 None] Group tempest-Group1-264875921: creating Feb 27 02:03:01 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-9ae8b7fb-b9f8-4a73-b4b5-ece7cc13528f tempest-GroupsTest-671880004 None] Group tempest-Group1-264875921: created successfully Feb 27 02:03:01 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-9ae8b7fb-b9f8-4a73-b4b5-ece7cc13528f tempest-GroupsTest-671880004 None] Create group completed successfully. Feb 27 02:03:01 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-0102e33e-25e0-48b7-b108-00e196b2850a tempest-GroupsTest-671880004 None] Group tempest-Group2-436668140: creating Feb 27 02:03:01 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-0102e33e-25e0-48b7-b108-00e196b2850a tempest-GroupsTest-671880004 None] Group tempest-Group2-436668140: created successfully Feb 27 02:03:01 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-0102e33e-25e0-48b7-b108-00e196b2850a tempest-GroupsTest-671880004 None] Create group completed successfully. Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Flow 'volume_create_manager' (483acbb0-611c-4f6b-bb9e-f52b6eea0908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (507004b6-5441-44a3-a63a-96c6f157156d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (507004b6-5441-44a3-a63a-96c6f157156d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1211871484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6618f0c8-c49c-4570-bc91-8b549c06af8d,host='devstack@QuobyteHD#QuobyteHD',id=67ff664e-d7e7-4426-bedf-babe13fe4d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ad9dbd640e401ca36f537fe96d193e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:03Z,use_quota=True,user_id='adcc045a76f243b281b29fef0cafd27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29287d3b-21ad-4e2a-9209-4190a056d33d),volume_type_id=29287d3b-21ad-4e2a-9209-4190a056d33d)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20813ca-a539-4ac3-9273-da30a8c418f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20813ca-a539-4ac3-9273-da30a8c418f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce89cc9-534f-426c-8847-9d7d48845c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce89cc9-534f-426c-8847-9d7d48845c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67ff664e-d7e7-4426-bedf-babe13fe4d81', 'volume_name': 'volume-67ff664e-d7e7-4426-bedf-babe13fe4d81', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31888c08-5a88-48c3-aad8-68d2450115d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31888c08-5a88-48c3-aad8-68d2450115d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e902747-76f7-46b6-98a3-89da91cf8431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:03 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Volume 67ff664e-d7e7-4426-bedf-babe13fe4d81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67ff664e-d7e7-4426-bedf-babe13fe4d81', 'volume_size': 1} Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6618f0c8-c49c-4570-bc91-8b549c06af8d,created_at=2026-02-27T01:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1211871484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6618f0c8-c49c-4570-bc91-8b549c06af8d,host='devstack@QuobyteHD#QuobyteHD',id=67ff664e-d7e7-4426-bedf-babe13fe4d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ad9dbd640e401ca36f537fe96d193e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:03Z,use_quota=True,user_id='adcc045a76f243b281b29fef0cafd27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29287d3b-21ad-4e2a-9209-4190a056d33d),volume_type_id=29287d3b-21ad-4e2a-9209-4190a056d33d)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Creating volume 67ff664e-d7e7-4426-bedf-babe13fe4d81 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:03 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:03:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-67ff664e-d7e7-4426-bedf-babe13fe4d81 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:03 devstack sudo[83115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-67ff664e-d7e7-4426-bedf-babe13fe4d81 1073741824 Feb 27 02:03:03 devstack sudo[83115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:04 devstack sudo[83115]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-67ff664e-d7e7-4426-bedf-babe13fe4d81 1073741824" returned: 0 in 0.777s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-67ff664e-d7e7-4426-bedf-babe13fe4d81 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:04 devstack sudo[83456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-67ff664e-d7e7-4426-bedf-babe13fe4d81 Feb 27 02:03:04 devstack sudo[83456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:04 devstack sudo[83456]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-67ff664e-d7e7-4426-bedf-babe13fe4d81" returned: 0 in 0.770s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e902747-76f7-46b6-98a3-89da91cf8431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67ff664e-d7e7-4426-bedf-babe13fe4d81', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99730d4-9103-4713-8898-40aa36cf45d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:05 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Volume volume-67ff664e-d7e7-4426-bedf-babe13fe4d81 (67ff664e-d7e7-4426-bedf-babe13fe4d81): created successfully Feb 27 02:03:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99730d4-9103-4713-8898-40aa36cf45d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Flow 'volume_create_manager' (483acbb0-611c-4f6b-bb9e-f52b6eea0908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:05 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-cdd6a9a2-fa03-4afb-9bac-2ce662114481 tempest-GroupsTest-671880004 None] Created volume successfully. Feb 27 02:03:05 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-450298c5-ab0c-4f62-a922-d8d5e3c9cb05 tempest-GroupSnapshotsTest-1373289962 None] Group tempest-GroupSnapshotsTest-Group-596060123: creating Feb 27 02:03:05 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-450298c5-ab0c-4f62-a922-d8d5e3c9cb05 tempest-GroupSnapshotsTest-1373289962 None] Group tempest-GroupSnapshotsTest-Group-596060123: created successfully Feb 27 02:03:05 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-450298c5-ab0c-4f62-a922-d8d5e3c9cb05 tempest-GroupSnapshotsTest-1373289962 None] Create group completed successfully. Feb 27 02:03:06 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] Acquiring lock "cinder-quobyte-67ff664e-d7e7-4426-bedf-babe13fe4d81" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:06 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] Lock "cinder-quobyte-67ff664e-d7e7-4426-bedf-babe13fe4d81" acquired by "delete_volume" :: waited 0.018s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:06 devstack cinder-volume[82738]: INFO oslo.privsep.daemon [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpe_5n7nxl/privsep.sock'] Feb 27 02:03:06 devstack sudo[83462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpe_5n7nxl/privsep.sock Feb 27 02:03:06 devstack sudo[83462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Flow 'volume_create_manager' (bf7ce71d-11ae-4dd2-8516-ebd0ac26afd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1721e3df-a928-49ac-9c9f-727f66a2acb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1721e3df-a928-49ac-9c9f-727f66a2acb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-966709691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1be3b8-b53d-4231-b956-d63fbdd5eec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c25fbe9772945daa10b9ded98918e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:07Z,use_quota=True,user_id='e3238a89743e4db5bd206aa103ae58fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ea5519-1f04-4eee-a212-f7634205637d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ea5519-1f04-4eee-a212-f7634205637d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802bec7a-ac8a-43c3-b6e6-d956cb56476d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802bec7a-ac8a-43c3-b6e6-d956cb56476d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab1be3b8-b53d-4231-b956-d63fbdd5eec6', 'volume_name': 'volume-ab1be3b8-b53d-4231-b956-d63fbdd5eec6', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18b0cc2-6e1c-4a58-b7ea-7c355ffe2432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18b0cc2-6e1c-4a58-b7ea-7c355ffe2432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98d9818-d8f0-4ffd-ad16-8fb6c65079fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:07 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Volume ab1be3b8-b53d-4231-b956-d63fbdd5eec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab1be3b8-b53d-4231-b956-d63fbdd5eec6', 'volume_size': 1} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-966709691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1be3b8-b53d-4231-b956-d63fbdd5eec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c25fbe9772945daa10b9ded98918e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:07Z,use_quota=True,user_id='e3238a89743e4db5bd206aa103ae58fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Creating volume ab1be3b8-b53d-4231-b956-d63fbdd5eec6 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:07 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ab1be3b8-b53d-4231-b956-d63fbdd5eec6 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:07 devstack sudo[83467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ab1be3b8-b53d-4231-b956-d63fbdd5eec6 1073741824 Feb 27 02:03:07 devstack sudo[83467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Flow 'volume_create_manager' (b8a1d4a7-8062-4401-b86e-435d4939f3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e03495-c820-4011-a5fa-954f3dacac43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e03495-c820-4011-a5fa-954f3dacac43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-561783632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ce2632b9-f4ff-4c92-8dc7-75a8f2766185,host='devstack@QuobyteHD#QuobyteHD',id=4aa54843-6617-41aa-a4ca-1032844b3c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4144072e72a477496da42b51d209d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:07Z,use_quota=True,user_id='f798e30bfbf444b78fec652125d8d88d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36af4877-4a14-4b6e-ac7e-510880c033fe),volume_type_id=36af4877-4a14-4b6e-ac7e-510880c033fe)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4716010f-fb56-47f2-9007-393a0bcabc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4716010f-fb56-47f2-9007-393a0bcabc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d8c710-e678-488f-9992-ede7d20a5461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d8c710-e678-488f-9992-ede7d20a5461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aa54843-6617-41aa-a4ca-1032844b3c00', 'volume_name': 'volume-4aa54843-6617-41aa-a4ca-1032844b3c00', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c091c629-44ed-4777-9a5c-c5329abc2f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c091c629-44ed-4777-9a5c-c5329abc2f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820bb58f-6dd4-4f30-a137-b61b520353d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:07 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Volume 4aa54843-6617-41aa-a4ca-1032844b3c00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aa54843-6617-41aa-a4ca-1032844b3c00', 'volume_size': 1} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:07 devstack sudo[83462]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:07 devstack cinder-volume[82738]: INFO oslo.privsep.daemon [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] Spawned new privsep daemon via rootwrap Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] Accepted privsep connection to /tmp/tmpe_5n7nxl/privsep.sock {{(pid=82738) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Feb 27 02:03:07 devstack cinder-volume[82738]: INFO oslo.privsep.daemon [-] privsep daemon starting Feb 27 02:03:07 devstack cinder-volume[82738]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Feb 27 02:03:07 devstack cinder-volume[82738]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Feb 27 02:03:07 devstack cinder-volume[82738]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83466 Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b953d5-8bea-4302-8c4b-a5984cc1cb76]: (2,) {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[90522546-6aa0-4519-a385-a7b9ad4ad7cc]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-67ff664e-d7e7-4426-bedf-babe13fe4d81 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:07 devstack sudo[83470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-67ff664e-d7e7-4426-bedf-babe13fe4d81 Feb 27 02:03:07 devstack sudo[83470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:08 devstack sudo[83467]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ab1be3b8-b53d-4231-b956-d63fbdd5eec6 1073741824" returned: 0 in 0.671s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ab1be3b8-b53d-4231-b956-d63fbdd5eec6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:08 devstack sudo[83480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ab1be3b8-b53d-4231-b956-d63fbdd5eec6 Feb 27 02:03:08 devstack sudo[83480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:08 devstack sudo[83470]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-67ff664e-d7e7-4426-bedf-babe13fe4d81" returned: 0 in 0.728s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-67ff664e-d7e7-4426-bedf-babe13fe4d81 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:08 devstack sudo[83482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-67ff664e-d7e7-4426-bedf-babe13fe4d81 Feb 27 02:03:08 devstack sudo[83482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:08 devstack sudo[83480]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ab1be3b8-b53d-4231-b956-d63fbdd5eec6" returned: 0 in 0.651s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.277s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ce2632b9-f4ff-4c92-8dc7-75a8f2766185,created_at=2026-02-27T01:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-561783632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ce2632b9-f4ff-4c92-8dc7-75a8f2766185,host='devstack@QuobyteHD#QuobyteHD',id=4aa54843-6617-41aa-a4ca-1032844b3c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4144072e72a477496da42b51d209d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:07Z,use_quota=True,user_id='f798e30bfbf444b78fec652125d8d88d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36af4877-4a14-4b6e-ac7e-510880c033fe),volume_type_id=36af4877-4a14-4b6e-ac7e-510880c033fe)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Creating volume 4aa54843-6617-41aa-a4ca-1032844b3c00 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:08 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:03:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:08 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98d9818-d8f0-4ffd-ad16-8fb6c65079fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab1be3b8-b53d-4231-b956-d63fbdd5eec6', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:08 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb28782b-e899-440f-8a52-a598d465f9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:08 devstack sudo[83487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 1073741824 Feb 27 02:03:08 devstack sudo[83487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:09 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Volume volume-ab1be3b8-b53d-4231-b956-d63fbdd5eec6 (ab1be3b8-b53d-4231-b956-d63fbdd5eec6): created successfully Feb 27 02:03:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb28782b-e899-440f-8a52-a598d465f9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Flow 'volume_create_manager' (bf7ce71d-11ae-4dd2-8516-ebd0ac26afd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:09 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-944f98e2-63d0-47b5-8bd0-615d94f51def tempest-VolumesAdminNegativeTest-1135639807 None] Created volume successfully. Feb 27 02:03:09 devstack sudo[83482]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-67ff664e-d7e7-4426-bedf-babe13fe4d81" returned: 0 in 0.769s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:09 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] Lock "cinder-quobyte-67ff664e-d7e7-4426-bedf-babe13fe4d81" released by "delete_volume" :: held 2.973s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:09 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] Created reservations ['990fb69c-48d8-43b8-bd6f-32b8f1f7dd20'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:09 devstack cinder-volume[82738]: WARNING cinder.quota [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1800714402 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1800714402, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:03:09 devstack cinder-volume[82738]: WARNING cinder.quota [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1800714402 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1800714402, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:03:09 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] Created reservations ['7e0c1a88-2517-4d31-a6d6-2ad809ed8cce', '685d2284-1746-4d11-8faa-19badb72a5b5', 'db334c8f-9282-4466-b0a1-7e4d78f892aa', 'c1c7ae63-c13f-45c5-9e3e-339d018270d8'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:10 devstack sudo[83492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:03:10 devstack sudo[83492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:10 devstack sudo[83487]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 1073741824" returned: 0 in 1.578s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:10 devstack sudo[83499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 Feb 27 02:03:10 devstack sudo[83499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:10 devstack sudo[83492]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.825s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:10 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:10 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-bcf69271-ac70-4fd8-991e-3a99e9d481f1 tempest-GroupsTest-671880004 None] Delete group completed successfully. Feb 27 02:03:10 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] Acquiring lock "cinder-ab1be3b8-b53d-4231-b956-d63fbdd5eec6-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:10 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] Lock "cinder-ab1be3b8-b53d-4231-b956-d63fbdd5eec6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] Acquiring lock "cinder-quobyte-ab1be3b8-b53d-4231-b956-d63fbdd5eec6" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] Lock "cinder-quobyte-ab1be3b8-b53d-4231-b956-d63fbdd5eec6" acquired by "delete_volume" :: waited 0.041s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:11 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1a49fb-b6b2-4a29-a726-ef1b9caed699]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ab1be3b8-b53d-4231-b956-d63fbdd5eec6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:11 devstack sudo[83501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ab1be3b8-b53d-4231-b956-d63fbdd5eec6 Feb 27 02:03:11 devstack sudo[83501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:11 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-e598a980-c49a-48c3-bee4-5b11ed3b21e8 tempest-GroupsTest-671880004 None] Created reservations ['ad931abb-938c-447e-932f-e91522b5f00d'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e598a980-c49a-48c3-bee4-5b11ed3b21e8 tempest-GroupsTest-671880004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e598a980-c49a-48c3-bee4-5b11ed3b21e8 tempest-GroupsTest-671880004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e598a980-c49a-48c3-bee4-5b11ed3b21e8 tempest-GroupsTest-671880004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e598a980-c49a-48c3-bee4-5b11ed3b21e8 tempest-GroupsTest-671880004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e598a980-c49a-48c3-bee4-5b11ed3b21e8 tempest-GroupsTest-671880004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e598a980-c49a-48c3-bee4-5b11ed3b21e8 tempest-GroupsTest-671880004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:11 devstack sudo[83504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:03:11 devstack sudo[83504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:11 devstack sudo[83499]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00" returned: 0 in 1.083s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] <== create_volume: return (2769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.773s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820bb58f-6dd4-4f30-a137-b61b520353d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aa54843-6617-41aa-a4ca-1032844b3c00', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b572bf-b00b-4173-8046-8fce8ca8f150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:11 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Volume volume-4aa54843-6617-41aa-a4ca-1032844b3c00 (4aa54843-6617-41aa-a4ca-1032844b3c00): created successfully Feb 27 02:03:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b572bf-b00b-4173-8046-8fce8ca8f150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Flow 'volume_create_manager' (b8a1d4a7-8062-4401-b86e-435d4939f3c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:11 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-58bd771a-2f16-4b39-b10c-4b8d4cb65d5c tempest-GroupSnapshotsTest-1373289962 None] Created volume successfully. Feb 27 02:03:12 devstack sudo[83501]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ab1be3b8-b53d-4231-b956-d63fbdd5eec6" returned: 0 in 1.104s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ab1be3b8-b53d-4231-b956-d63fbdd5eec6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:12 devstack sudo[83510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ab1be3b8-b53d-4231-b956-d63fbdd5eec6 Feb 27 02:03:12 devstack sudo[83510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:12 devstack sudo[83504]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e598a980-c49a-48c3-bee4-5b11ed3b21e8 tempest-GroupsTest-671880004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 1.092s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:12 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-e598a980-c49a-48c3-bee4-5b11ed3b21e8 tempest-GroupsTest-671880004 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:12 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e598a980-c49a-48c3-bee4-5b11ed3b21e8 tempest-GroupsTest-671880004 None] Delete group completed successfully. Feb 27 02:03:12 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] GroupSnapshot a9ca26b2-115e-470d-8b8a-00f4fab6cdbf: creating. Feb 27 02:03:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] Group snapshot a9ca26b2-115e-470d-8b8a-00f4fab6cdbf: creating. {{(pid=82738) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 02:03:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] Creating offline snapshot 3a3b1f64-e889-48d8-b171-ee6976ba2423 of volume 4aa54843-6617-41aa-a4ca-1032844b3c00 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:03:13 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda52bf5-a9dd-4ef7-956e-182b7fb3262b]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:13 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e5906195-01ff-4f87-80a9-970c435e8eaa tempest-GroupsTest-671880004 None] Group tempest-GroupsTest-Group-2122559419: creating Feb 27 02:03:13 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e5906195-01ff-4f87-80a9-970c435e8eaa tempest-GroupsTest-671880004 None] Group tempest-GroupsTest-Group-2122559419: created successfully Feb 27 02:03:13 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e5906195-01ff-4f87-80a9-970c435e8eaa tempest-GroupsTest-671880004 None] Create group completed successfully. Feb 27 02:03:13 devstack sudo[83515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 Feb 27 02:03:13 devstack sudo[83515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:13 devstack sudo[83510]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ab1be3b8-b53d-4231-b956-d63fbdd5eec6" returned: 0 in 1.435s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] Lock "cinder-quobyte-ab1be3b8-b53d-4231-b956-d63fbdd5eec6" released by "delete_volume" :: held 2.633s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:13 devstack cinder-volume[82738]: WARNING cinder.quota [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:03:13 devstack cinder-volume[82738]: WARNING cinder.quota [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:03:13 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] Created reservations ['7dba954e-463a-48f1-867a-da45c6a6d1be', '8629f4d5-4360-4c5c-9d80-e688e5404370', '6994b20b-9fb0-4a6e-b906-538549f9fa1f', '62864cd9-af8b-4e91-abe6-bb8f300de2b5'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:13 devstack sudo[83518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:03:13 devstack sudo[83518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:14 devstack sudo[83515]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00" returned: 0 in 0.912s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:14 devstack sudo[83523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423 1G Feb 27 02:03:14 devstack sudo[83523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:14 devstack sudo[83518]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.490s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:14 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:14 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] Deleted volume successfully. Feb 27 02:03:14 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-2dd37b1d-9d98-4d67-bb80-38f251931b63 tempest-VolumesAdminNegativeTest-1135639807 None] Lock "cinder-ab1be3b8-b53d-4231-b956-d63fbdd5eec6-delete_volume" released by "delete_volume" :: held 3.424s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:14 devstack sudo[83523]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423 1G" returned: 0 in 0.715s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aa54843-6617-41aa-a4ca-1032844b3c00 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:14 devstack sudo[83529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aa54843-6617-41aa-a4ca-1032844b3c00 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423 Feb 27 02:03:14 devstack sudo[83529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:15 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Flow 'volume_create_manager' (2bcd77d2-20d1-4fbf-9f63-9d4e6868bdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1efea8ad-bc81-47df-a6ff-dfc78549c5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1efea8ad-bc81-47df-a6ff-dfc78549c5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1364210427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0a148f3-e619-4252-b639-cf7c0793d671,host='devstack@QuobyteHD#QuobyteHD',id=483e64a7-83ce-4d08-822f-039e2b5749e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ad9dbd640e401ca36f537fe96d193e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:15Z,use_quota=True,user_id='adcc045a76f243b281b29fef0cafd27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8626a7b-08f3-4273-ac0d-e4439cfb1bc9),volume_type_id=f8626a7b-08f3-4273-ac0d-e4439cfb1bc9)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb76dbc-5e07-4d59-b943-a2f5cbf8a488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb76dbc-5e07-4d59-b943-a2f5cbf8a488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e48b20-6bcc-4305-88ed-87029cb6fbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e48b20-6bcc-4305-88ed-87029cb6fbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '483e64a7-83ce-4d08-822f-039e2b5749e3', 'volume_name': 'volume-483e64a7-83ce-4d08-822f-039e2b5749e3', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043bea5b-326a-4c9d-ba77-dd761ff32a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043bea5b-326a-4c9d-ba77-dd761ff32a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4846e753-98e0-444c-bd91-6836aa5cb151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:15 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Volume 483e64a7-83ce-4d08-822f-039e2b5749e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-483e64a7-83ce-4d08-822f-039e2b5749e3', 'volume_size': 1} Feb 27 02:03:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:15 devstack sudo[83529]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aa54843-6617-41aa-a4ca-1032844b3c00 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423" returned: 0 in 0.869s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:15 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:03:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:15 devstack sudo[83540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423 Feb 27 02:03:15 devstack sudo[83540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:16 devstack sudo[83540]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423" returned: 0 in 0.771s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:16 devstack sudo[83600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.info Feb 27 02:03:16 devstack sudo[83600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:17 devstack sudo[83600]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.info" returned: 0 in 0.598s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:17 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:03:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:17 devstack sudo[83606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.info Feb 27 02:03:17 devstack sudo[83606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:17 devstack sudo[83606]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.info" returned: 0 in 0.554s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.590s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.402s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:17 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f0a148f3-e619-4252-b639-cf7c0793d671,created_at=2026-02-27T01:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1364210427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0a148f3-e619-4252-b639-cf7c0793d671,host='devstack@QuobyteHD#QuobyteHD',id=483e64a7-83ce-4d08-822f-039e2b5749e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ad9dbd640e401ca36f537fe96d193e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:15Z,use_quota=True,user_id='adcc045a76f243b281b29fef0cafd27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8626a7b-08f3-4273-ac0d-e4439cfb1bc9),volume_type_id=f8626a7b-08f3-4273-ac0d-e4439cfb1bc9)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:17 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Creating volume 483e64a7-83ce-4d08-822f-039e2b5749e3 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:17 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:17 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:17 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:17 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:03:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-483e64a7-83ce-4d08-822f-039e2b5749e3 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:17 devstack sudo[83609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-483e64a7-83ce-4d08-822f-039e2b5749e3 1073741824 Feb 27 02:03:17 devstack sudo[83609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:17 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-cb88ac23-1da4-4716-9668-eacd656f65ec tempest-GroupSnapshotsTest-1373289962 None] group_snapshot a9ca26b2-115e-470d-8b8a-00f4fab6cdbf: created successfully Feb 27 02:03:18 devstack sudo[83609]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-483e64a7-83ce-4d08-822f-039e2b5749e3 1073741824" returned: 0 in 1.043s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-483e64a7-83ce-4d08-822f-039e2b5749e3 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:18 devstack sudo[83616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-483e64a7-83ce-4d08-822f-039e2b5749e3 Feb 27 02:03:18 devstack sudo[83616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:19 devstack sudo[83616]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-483e64a7-83ce-4d08-822f-039e2b5749e3" returned: 0 in 0.553s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4846e753-98e0-444c-bd91-6836aa5cb151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-483e64a7-83ce-4d08-822f-039e2b5749e3', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6c7bc6-978b-4a94-89ac-cf90939ed0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:19 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Volume volume-483e64a7-83ce-4d08-822f-039e2b5749e3 (483e64a7-83ce-4d08-822f-039e2b5749e3): created successfully Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6c7bc6-978b-4a94-89ac-cf90939ed0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Flow 'volume_create_manager' (2bcd77d2-20d1-4fbf-9f63-9d4e6868bdb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:19 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-83ac5ad4-3347-4981-b511-8919ff2e7d9e tempest-GroupsTest-671880004 None] Created volume successfully. Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "cinder-quobyte-3a3b1f64-e889-48d8-b171-ee6976ba2423-f671ed4a-cb8b-4158-8379-4c0bdc0158ea" by "_create_volume_from_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-3a3b1f64-e889-48d8-b171-ee6976ba2423-f671ed4a-cb8b-4158-8379-4c0bdc0158ea" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Creating volume f671ed4a-cb8b-4158-8379-4c0bdc0158ea from snapshot 3a3b1f64-e889-48d8-b171-ee6976ba2423 {{(pid=82738) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "cinder-quobyte-f671ed4a-cb8b-4158-8379-4c0bdc0158ea" by "_copy_volume_from_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-f671ed4a-cb8b-4158-8379-4c0bdc0158ea" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] snapshot: 3a3b1f64-e889-48d8-b171-ee6976ba2423, volume: f671ed4a-cb8b-4158-8379-4c0bdc0158ea, {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[972940ef-59f8-44d3-91cf-662e41f55a96]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:19 devstack sudo[83623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423 Feb 27 02:03:19 devstack sudo[83623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:20 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Flow 'volume_create_manager' (a3f18291-f6db-46cd-8549-20fb58b5362e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c9b9a7-a92b-48f6-a854-aa6c8957d853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c9b9a7-a92b-48f6-a854-aa6c8957d853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1719979550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0a148f3-e619-4252-b639-cf7c0793d671,host='devstack@QuobyteHD#QuobyteHD',id=5c3ec7d4-2e6d-425d-9add-e6eace6c0d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ad9dbd640e401ca36f537fe96d193e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:20Z,use_quota=True,user_id='adcc045a76f243b281b29fef0cafd27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8626a7b-08f3-4273-ac0d-e4439cfb1bc9),volume_type_id=f8626a7b-08f3-4273-ac0d-e4439cfb1bc9)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2810d9f-1c87-41c2-888f-5e721c030d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2810d9f-1c87-41c2-888f-5e721c030d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef90a28-1f92-4405-bd04-c41462cad9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef90a28-1f92-4405-bd04-c41462cad9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c3ec7d4-2e6d-425d-9add-e6eace6c0d65', 'volume_name': 'volume-5c3ec7d4-2e6d-425d-9add-e6eace6c0d65', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf14b43-c972-4520-a14b-656fc07345ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf14b43-c972-4520-a14b-656fc07345ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adb815d-b96d-46b9-9f32-7d7085c747e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:20 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Volume 5c3ec7d4-2e6d-425d-9add-e6eace6c0d65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c3ec7d4-2e6d-425d-9add-e6eace6c0d65', 'volume_size': 1} Feb 27 02:03:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:20 devstack sudo[83623]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423" returned: 0 in 0.785s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4aa54843-6617-41aa-a4ca-1032844b3c00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:03:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Creating direct copy from snapshot {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:03:20 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ad5dfd-ebce-4fe3-b9ba-6660f0bb6a62]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:20 devstack sudo[83641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 Feb 27 02:03:20 devstack sudo[83641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:21 devstack sudo[83641]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00" returned: 0 in 0.576s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:21 devstack cinder-volume[82738]: DEBUG cinder.utils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Path /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f671ed4a-cb8b-4158-8379-4c0bdc0158ea not found in is_blk_device check {{(pid=82738) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:03:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f671ed4a-cb8b-4158-8379-4c0bdc0158ea {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:21 devstack sudo[83647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f671ed4a-cb8b-4158-8379-4c0bdc0158ea Feb 27 02:03:21 devstack sudo[83647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:23 devstack cinder-volume[82738]: DEBUG oslo_service.periodic_task [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82738) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:03:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:23 devstack sudo[83675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:03:23 devstack sudo[83675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:24 devstack sudo[83647]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f671ed4a-cb8b-4158-8379-4c0bdc0158ea" returned: 0 in 3.728s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:24 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ab2b95-d77f-436c-93c5-f0ac46a34339]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:25 devstack sudo[83677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 Feb 27 02:03:25 devstack sudo[83677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:25 devstack sudo[83675]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 1.479s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:25 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:25 devstack sudo[83677]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00" returned: 0 in 0.843s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:25 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00, size 1024.00 MB, duration 3.73 sec, destination /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f671ed4a-cb8b-4158-8379-4c0bdc0158ea {{(pid=82738) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:03:25 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Converted 1024.00 MB image at 274.60 MB/s Feb 27 02:03:25 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f671ed4a-cb8b-4158-8379-4c0bdc0158ea is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:03:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f671ed4a-cb8b-4158-8379-4c0bdc0158ea {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:25 devstack sudo[83684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f671ed4a-cb8b-4158-8379-4c0bdc0158ea Feb 27 02:03:25 devstack sudo[83684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:26 devstack sudo[83684]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f671ed4a-cb8b-4158-8379-4c0bdc0158ea" returned: 0 in 0.607s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:26 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-f671ed4a-cb8b-4158-8379-4c0bdc0158ea" released by "_copy_volume_from_snapshot" :: held 6.627s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:26 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-3a3b1f64-e889-48d8-b171-ee6976ba2423-f671ed4a-cb8b-4158-8379-4c0bdc0158ea" released by "_create_volume_from_snapshot" :: held 6.650s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.661s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.870s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f0a148f3-e619-4252-b639-cf7c0793d671,created_at=2026-02-27T01:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1719979550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0a148f3-e619-4252-b639-cf7c0793d671,host='devstack@QuobyteHD#QuobyteHD',id=5c3ec7d4-2e6d-425d-9add-e6eace6c0d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ad9dbd640e401ca36f537fe96d193e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:20Z,use_quota=True,user_id='adcc045a76f243b281b29fef0cafd27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8626a7b-08f3-4273-ac0d-e4439cfb1bc9),volume_type_id=f8626a7b-08f3-4273-ac0d-e4439cfb1bc9)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Creating volume 5c3ec7d4-2e6d-425d-9add-e6eace6c0d65 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:26 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:03:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5c3ec7d4-2e6d-425d-9add-e6eace6c0d65 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:26 devstack sudo[83690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5c3ec7d4-2e6d-425d-9add-e6eace6c0d65 1073741824 Feb 27 02:03:26 devstack sudo[83690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:26 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-f72b81ff-bd72-4cde-844e-d103a0633ca5 tempest-GroupSnapshotsTest-1373289962 None] Create group from source-snapshot-a9ca26b2-115e-470d-8b8a-00f4fab6cdbf completed successfully. Feb 27 02:03:27 devstack sudo[83690]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5c3ec7d4-2e6d-425d-9add-e6eace6c0d65 1073741824" returned: 0 in 0.726s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5c3ec7d4-2e6d-425d-9add-e6eace6c0d65 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:27 devstack sudo[83695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5c3ec7d4-2e6d-425d-9add-e6eace6c0d65 Feb 27 02:03:27 devstack sudo[83695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:27 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5f785ac7-3467-4aff-9b3a-0aa1322455eb tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "cinder-quobyte-f671ed4a-cb8b-4158-8379-4c0bdc0158ea" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:27 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5f785ac7-3467-4aff-9b3a-0aa1322455eb tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-f671ed4a-cb8b-4158-8379-4c0bdc0158ea" acquired by "delete_volume" :: waited 0.029s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:27 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5218d0-e1b3-4163-bca6-a3f8652b5599]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5f785ac7-3467-4aff-9b3a-0aa1322455eb tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f671ed4a-cb8b-4158-8379-4c0bdc0158ea {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:27 devstack sudo[83698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f671ed4a-cb8b-4158-8379-4c0bdc0158ea Feb 27 02:03:27 devstack sudo[83698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:28 devstack sudo[83695]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5c3ec7d4-2e6d-425d-9add-e6eace6c0d65" returned: 0 in 1.272s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:28 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] <== create_volume: return (2038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:28 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adb815d-b96d-46b9-9f32-7d7085c747e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c3ec7d4-2e6d-425d-9add-e6eace6c0d65', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:28 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1012067c-7cdf-4383-bb8a-853c73fa0bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:28 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Volume volume-5c3ec7d4-2e6d-425d-9add-e6eace6c0d65 (5c3ec7d4-2e6d-425d-9add-e6eace6c0d65): created successfully Feb 27 02:03:28 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1012067c-7cdf-4383-bb8a-853c73fa0bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:28 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Flow 'volume_create_manager' (a3f18291-f6db-46cd-8549-20fb58b5362e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:28 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-6cc4b3fb-714d-4085-8fa5-789f04183255 tempest-GroupsTest-671880004 None] Created volume successfully. Feb 27 02:03:29 devstack sudo[83698]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5f785ac7-3467-4aff-9b3a-0aa1322455eb tempest-GroupSnapshotsTest-1373289962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f671ed4a-cb8b-4158-8379-4c0bdc0158ea" returned: 0 in 1.378s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5f785ac7-3467-4aff-9b3a-0aa1322455eb tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f671ed4a-cb8b-4158-8379-4c0bdc0158ea {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:29 devstack sudo[83730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f671ed4a-cb8b-4158-8379-4c0bdc0158ea Feb 27 02:03:29 devstack sudo[83730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:29 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-54711da8-4c2f-4249-b3c4-fa101e462eeb tempest-GroupsTest-671880004 None] Update group completed successfully. Feb 27 02:03:29 devstack sudo[83730]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5f785ac7-3467-4aff-9b3a-0aa1322455eb tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f671ed4a-cb8b-4158-8379-4c0bdc0158ea" returned: 0 in 0.785s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:29 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5f785ac7-3467-4aff-9b3a-0aa1322455eb tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-f671ed4a-cb8b-4158-8379-4c0bdc0158ea" released by "delete_volume" :: held 2.208s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:29 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-5f785ac7-3467-4aff-9b3a-0aa1322455eb tempest-GroupSnapshotsTest-1373289962 None] Created reservations ['33f4b481-b017-4959-adf4-13a85e8f9fcf'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:29 devstack cinder-volume[82738]: WARNING cinder.quota [None req-5f785ac7-3467-4aff-9b3a-0aa1322455eb tempest-GroupSnapshotsTest-1373289962 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-438187528 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-438187528, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:03:30 devstack cinder-volume[82738]: WARNING cinder.quota [None req-5f785ac7-3467-4aff-9b3a-0aa1322455eb tempest-GroupSnapshotsTest-1373289962 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-438187528 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-438187528, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:03:30 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-5f785ac7-3467-4aff-9b3a-0aa1322455eb tempest-GroupSnapshotsTest-1373289962 None] Created reservations ['c5a6db29-5a81-47fe-8760-1caf7729477b', '857e4484-5fe7-4cc0-ac80-7a6ce3d51d58', 'f01e36d0-e799-4f2b-b0c5-ab20775091f5', '514104e2-4377-43a5-a3e2-456a9eea2e9b'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5f785ac7-3467-4aff-9b3a-0aa1322455eb tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5f785ac7-3467-4aff-9b3a-0aa1322455eb tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:30 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5f785ac7-3467-4aff-9b3a-0aa1322455eb tempest-GroupSnapshotsTest-1373289962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:30 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5f785ac7-3467-4aff-9b3a-0aa1322455eb tempest-GroupSnapshotsTest-1373289962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5f785ac7-3467-4aff-9b3a-0aa1322455eb tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5f785ac7-3467-4aff-9b3a-0aa1322455eb tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:30 devstack sudo[83734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:03:30 devstack sudo[83734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:30 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-b0c08c17-9525-4fd0-8b19-e8ab6392d0fe tempest-GroupsTest-671880004 None] Update group completed successfully. Feb 27 02:03:31 devstack sudo[83734]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5f785ac7-3467-4aff-9b3a-0aa1322455eb tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.993s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:31 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-5f785ac7-3467-4aff-9b3a-0aa1322455eb tempest-GroupSnapshotsTest-1373289962 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:31 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-5f785ac7-3467-4aff-9b3a-0aa1322455eb tempest-GroupSnapshotsTest-1373289962 None] Delete group completed successfully. Feb 27 02:03:31 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] group_snapshot a9ca26b2-115e-470d-8b8a-00f4fab6cdbf: deleting Feb 27 02:03:31 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] group_snapshot a9ca26b2-115e-470d-8b8a-00f4fab6cdbf: deleting {{(pid=82738) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 02:03:31 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "cinder-quobyte-4aa54843-6617-41aa-a4ca-1032844b3c00" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:31 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-4aa54843-6617-41aa-a4ca-1032844b3c00" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:31 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "cinder-quobyte-3a3b1f64-e889-48d8-b171-ee6976ba2423" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:31 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-3a3b1f64-e889-48d8-b171-ee6976ba2423" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:31 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] Deleting offline snapshot 3a3b1f64-e889-48d8-b171-ee6976ba2423 of volume 4aa54843-6617-41aa-a4ca-1032844b3c00 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:03:31 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] snapshot_file for this snap is: volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:03:31 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d84a47-1018-4201-99ef-cbb730d9f875]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:31 devstack sudo[83739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423 Feb 27 02:03:31 devstack sudo[83739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:32 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Acquiring lock "cinder-quobyte-483e64a7-83ce-4d08-822f-039e2b5749e3" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:32 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Lock "cinder-quobyte-483e64a7-83ce-4d08-822f-039e2b5749e3" acquired by "delete_volume" :: waited 0.058s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:32 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[b083d28c-f013-4881-8699-85638f51afbb]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-483e64a7-83ce-4d08-822f-039e2b5749e3 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:32 devstack sudo[83739]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423" returned: 0 in 1.241s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:32 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4aa54843-6617-41aa-a4ca-1032844b3c00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:32 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cbcb6f-8e51-4a28-8b01-776d0a7a31bd]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:32 devstack sudo[83751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-483e64a7-83ce-4d08-822f-039e2b5749e3 Feb 27 02:03:32 devstack sudo[83751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:32 devstack sudo[83752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 Feb 27 02:03:32 devstack sudo[83752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:33 devstack sudo[83751]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-483e64a7-83ce-4d08-822f-039e2b5749e3" returned: 0 in 0.991s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-483e64a7-83ce-4d08-822f-039e2b5749e3 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:33 devstack sudo[83777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-483e64a7-83ce-4d08-822f-039e2b5749e3 Feb 27 02:03:33 devstack sudo[83777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:33 devstack sudo[83752]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00" returned: 0 in 1.091s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:33 devstack sudo[83780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423 Feb 27 02:03:33 devstack sudo[83780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:34 devstack sudo[83777]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-483e64a7-83ce-4d08-822f-039e2b5749e3" returned: 0 in 0.794s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:34 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Lock "cinder-quobyte-483e64a7-83ce-4d08-822f-039e2b5749e3" released by "delete_volume" :: held 1.829s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:34 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Acquiring lock "cinder-quobyte-5c3ec7d4-2e6d-425d-9add-e6eace6c0d65" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:34 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Lock "cinder-quobyte-5c3ec7d4-2e6d-425d-9add-e6eace6c0d65" acquired by "delete_volume" :: waited 0.083s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:34 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f6b559-21ef-4946-8493-1dd09d4c0882]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5c3ec7d4-2e6d-425d-9add-e6eace6c0d65 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:34 devstack sudo[83788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5c3ec7d4-2e6d-425d-9add-e6eace6c0d65 Feb 27 02:03:34 devstack sudo[83788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:34 devstack sudo[83780]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423" returned: 0 in 0.989s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:34 devstack sudo[83791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423 Feb 27 02:03:34 devstack sudo[83791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:35 devstack sudo[83788]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5c3ec7d4-2e6d-425d-9add-e6eace6c0d65" returned: 0 in 1.020s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5c3ec7d4-2e6d-425d-9add-e6eace6c0d65 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:35 devstack sudo[83791]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00.3a3b1f64-e889-48d8-b171-ee6976ba2423" returned: 0 in 0.811s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:35 devstack sudo[83798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5c3ec7d4-2e6d-425d-9add-e6eace6c0d65 Feb 27 02:03:35 devstack sudo[83798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-3a3b1f64-e889-48d8-b171-ee6976ba2423" released by "_delete_snapshot" :: held 4.296s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-4aa54843-6617-41aa-a4ca-1032844b3c00" released by "delete_snapshot" :: held 4.336s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:35 devstack cinder-volume[82738]: WARNING cinder.quota [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-438187528 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-438187528, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:03:35 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] Created reservations ['361300dd-16e8-4ac9-afd0-2e2a512ad695', '19efe235-7053-43d0-9e4a-a229db17448c', '30cba78e-baf0-478e-b93a-9f02ca05238f', '8f85e589-78fa-4c6e-b554-f7c7a82f3b29'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:35 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-0df3b709-c800-403b-93eb-5b1f2fa21f85 tempest-GroupSnapshotsTest-1373289962 None] group_snapshot a9ca26b2-115e-470d-8b8a-00f4fab6cdbf: deleted successfully Feb 27 02:03:36 devstack sudo[83798]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5c3ec7d4-2e6d-425d-9add-e6eace6c0d65" returned: 0 in 0.725s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:36 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Lock "cinder-quobyte-5c3ec7d4-2e6d-425d-9add-e6eace6c0d65" released by "delete_volume" :: held 1.777s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:36 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Created reservations ['a3a369df-dd0f-4a95-9171-8d1a8a072eb6'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:36 devstack cinder-volume[82738]: WARNING cinder.quota [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1289823994 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1289823994, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:03:36 devstack cinder-volume[82738]: WARNING cinder.quota [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1289823994 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1289823994, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:03:36 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Created reservations ['077ffe91-a879-4f09-bbe7-c37d1801b977', 'ba9a38fa-56b0-4115-b9ba-4c9195c86879', 'b89807f5-e084-4f59-8beb-51f43bbdfbdf', '75cc02bc-9438-4b25-8e38-5e22a4d91071'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:36 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Created reservations ['c67c3fe5-55bd-4b92-8555-15cc11e37556', 'fd6a5966-62fa-408d-9af7-17bd2b2989fc', '5a3410b3-7647-40dd-8646-d46bf16589c8', '8af72898-9d3b-44b9-8e6e-babc7de93909'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:36 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:36 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:36 devstack sudo[83809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:03:36 devstack sudo[83809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:37 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-2fd60523-4277-4f26-80c5-02c06851851f tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "cinder-quobyte-4aa54843-6617-41aa-a4ca-1032844b3c00" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:37 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-2fd60523-4277-4f26-80c5-02c06851851f tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-4aa54843-6617-41aa-a4ca-1032844b3c00" acquired by "delete_volume" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:37 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b222bd7-ed94-48d0-b855-00e2e7961867]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2fd60523-4277-4f26-80c5-02c06851851f tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:37 devstack sudo[83811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 Feb 27 02:03:37 devstack sudo[83811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:37 devstack sudo[83809]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.830s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:37 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:37 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-4142275c-0350-4e83-8595-35dfbfb895ca tempest-GroupsTest-671880004 None] Delete group completed successfully. Feb 27 02:03:37 devstack sudo[83811]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2fd60523-4277-4f26-80c5-02c06851851f tempest-GroupSnapshotsTest-1373289962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00" returned: 0 in 0.814s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2fd60523-4277-4f26-80c5-02c06851851f tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:38 devstack sudo[83826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00 Feb 27 02:03:38 devstack sudo[83826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:38 devstack sudo[83826]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2fd60523-4277-4f26-80c5-02c06851851f tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4aa54843-6617-41aa-a4ca-1032844b3c00" returned: 0 in 0.715s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:38 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-2fd60523-4277-4f26-80c5-02c06851851f tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-4aa54843-6617-41aa-a4ca-1032844b3c00" released by "delete_volume" :: held 1.600s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:38 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-2fd60523-4277-4f26-80c5-02c06851851f tempest-GroupSnapshotsTest-1373289962 None] Created reservations ['bef7ab2a-3c43-416b-a8af-fd10033ad36e'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:38 devstack cinder-volume[82738]: WARNING cinder.db.sqlalchemy.api [None req-2fd60523-4277-4f26-80c5-02c06851851f tempest-GroupSnapshotsTest-1373289962 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-438187528'] Feb 27 02:03:38 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-2fd60523-4277-4f26-80c5-02c06851851f tempest-GroupSnapshotsTest-1373289962 None] Created reservations ['6ebfe2b7-e0e8-42bb-87c1-ca5a6129c2d7', '745e6a7f-010b-43c3-8427-1f03d6f6a456', 'e1cc4d16-7a3d-466f-b599-e2ae5f402e39', '16903e62-aa55-4404-97eb-936d51ca47b8'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2fd60523-4277-4f26-80c5-02c06851851f tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2fd60523-4277-4f26-80c5-02c06851851f tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:38 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-2fd60523-4277-4f26-80c5-02c06851851f tempest-GroupSnapshotsTest-1373289962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:38 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-2fd60523-4277-4f26-80c5-02c06851851f tempest-GroupSnapshotsTest-1373289962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2fd60523-4277-4f26-80c5-02c06851851f tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2fd60523-4277-4f26-80c5-02c06851851f tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:38 devstack sudo[83829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:03:38 devstack sudo[83829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:39 devstack sudo[83829]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2fd60523-4277-4f26-80c5-02c06851851f tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.738s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:39 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-2fd60523-4277-4f26-80c5-02c06851851f tempest-GroupSnapshotsTest-1373289962 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:39 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-2fd60523-4277-4f26-80c5-02c06851851f tempest-GroupSnapshotsTest-1373289962 None] Delete group completed successfully. Feb 27 02:03:40 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-cd5f1a91-fe79-4e5b-ad53-f867e3640742 tempest-GroupSnapshotsTest-1373289962 None] Group tempest-GroupSnapshotsTest-Group-1946114913: creating Feb 27 02:03:40 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-cd5f1a91-fe79-4e5b-ad53-f867e3640742 tempest-GroupSnapshotsTest-1373289962 None] Group tempest-GroupSnapshotsTest-Group-1946114913: created successfully Feb 27 02:03:40 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-cd5f1a91-fe79-4e5b-ad53-f867e3640742 tempest-GroupSnapshotsTest-1373289962 None] Create group completed successfully. Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Flow 'volume_create_manager' (3c481c6c-dd0c-4a71-b310-d06631a0dd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23afe0f8-bbb2-45c1-b4ce-36848ef8754b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23afe0f8-bbb2-45c1-b4ce-36848ef8754b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-760965847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f57bc40-3e8d-4768-abdf-7329a0ffe19f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2db2b49cc542868dc1dc3d980a6aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:40Z,use_quota=True,user_id='a239b04b70ab4bb09811650bcfb3c77c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd91767e-428d-4810-b4c4-8de5cb0bb4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd91767e-428d-4810-b4c4-8de5cb0bb4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133edb04-2c53-47cd-85b0-c5e72f723d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133edb04-2c53-47cd-85b0-c5e72f723d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f57bc40-3e8d-4768-abdf-7329a0ffe19f', 'volume_name': 'volume-6f57bc40-3e8d-4768-abdf-7329a0ffe19f', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f55075-645a-41d1-bd68-00a9a710ca6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f55075-645a-41d1-bd68-00a9a710ca6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc5905e-2cbd-4caa-837b-d16629a88371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:40 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Volume 6f57bc40-3e8d-4768-abdf-7329a0ffe19f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f57bc40-3e8d-4768-abdf-7329a0ffe19f', 'volume_size': 1} Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-760965847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f57bc40-3e8d-4768-abdf-7329a0ffe19f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2db2b49cc542868dc1dc3d980a6aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:40Z,use_quota=True,user_id='a239b04b70ab4bb09811650bcfb3c77c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Creating volume 6f57bc40-3e8d-4768-abdf-7329a0ffe19f {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:40 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:03:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f57bc40-3e8d-4768-abdf-7329a0ffe19f 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:40 devstack sudo[83834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f57bc40-3e8d-4768-abdf-7329a0ffe19f 1073741824 Feb 27 02:03:40 devstack sudo[83834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f57bc40-3e8d-4768-abdf-7329a0ffe19f 1073741824" returned: 0 in 0.986s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:41 devstack sudo[83834]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f57bc40-3e8d-4768-abdf-7329a0ffe19f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:41 devstack sudo[83839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f57bc40-3e8d-4768-abdf-7329a0ffe19f Feb 27 02:03:41 devstack sudo[83839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:41 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Flow 'volume_create_manager' (9712bc43-0f37-4865-a83f-39d8da50e320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743da09f-79d2-49a6-9f78-e14766c914b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743da09f-79d2-49a6-9f78-e14766c914b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1767699534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ce693091-f814-4852-ac84-180e905557ae,host='devstack@QuobyteHD#QuobyteHD',id=2a089c66-1b5f-45c3-bc15-6cc82164c3e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4144072e72a477496da42b51d209d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:42Z,use_quota=True,user_id='f798e30bfbf444b78fec652125d8d88d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a003afe-6965-4a13-84bd-b1970bbf5922),volume_type_id=1a003afe-6965-4a13-84bd-b1970bbf5922)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7657cc8-d919-4e08-84a4-9c0d2f4db45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7657cc8-d919-4e08-84a4-9c0d2f4db45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c42de9-8a85-475e-b027-4c1e0c85aa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c42de9-8a85-475e-b027-4c1e0c85aa13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a089c66-1b5f-45c3-bc15-6cc82164c3e7', 'volume_name': 'volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8df8fc-67c1-4221-9d50-b76b1c496794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8df8fc-67c1-4221-9d50-b76b1c496794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50440cd-a6aa-4228-bb37-b729b50365d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:41 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Volume 2a089c66-1b5f-45c3-bc15-6cc82164c3e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7', 'volume_size': 1} Feb 27 02:03:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:42 devstack sudo[83839]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f57bc40-3e8d-4768-abdf-7329a0ffe19f" returned: 0 in 0.654s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:42 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.479s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:42 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ce693091-f814-4852-ac84-180e905557ae,created_at=2026-02-27T01:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1767699534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ce693091-f814-4852-ac84-180e905557ae,host='devstack@QuobyteHD#QuobyteHD',id=2a089c66-1b5f-45c3-bc15-6cc82164c3e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4144072e72a477496da42b51d209d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:42Z,use_quota=True,user_id='f798e30bfbf444b78fec652125d8d88d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a003afe-6965-4a13-84bd-b1970bbf5922),volume_type_id=1a003afe-6965-4a13-84bd-b1970bbf5922)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:42 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Creating volume 2a089c66-1b5f-45c3-bc15-6cc82164c3e7 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:42 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:42 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:42 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:42 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:03:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:42 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc5905e-2cbd-4caa-837b-d16629a88371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f57bc40-3e8d-4768-abdf-7329a0ffe19f', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:42 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b624a23-c798-441d-816d-504c393a8bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:42 devstack sudo[83842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7 1073741824 Feb 27 02:03:42 devstack sudo[83842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:42 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Volume volume-6f57bc40-3e8d-4768-abdf-7329a0ffe19f (6f57bc40-3e8d-4768-abdf-7329a0ffe19f): created successfully Feb 27 02:03:42 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b624a23-c798-441d-816d-504c393a8bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:42 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Flow 'volume_create_manager' (3c481c6c-dd0c-4a71-b310-d06631a0dd0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:42 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-727bc8c8-fc27-4789-8184-c99e81da4582 tempest-ServersNegativeTestJSON-191337519 None] Created volume successfully. Feb 27 02:03:43 devstack sudo[83842]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7 1073741824" returned: 0 in 0.761s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:43 devstack sudo[83847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7 Feb 27 02:03:43 devstack sudo[83847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:43 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-94d83b70-1983-428f-a2de-5eae38d037e4 tempest-GroupsV320Test-518704721 None] Group tempest-GroupsV320Test-Group-1146262782: creating Feb 27 02:03:43 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-94d83b70-1983-428f-a2de-5eae38d037e4 tempest-GroupsV320Test-518704721 None] Group tempest-GroupsV320Test-Group-1146262782: created successfully Feb 27 02:03:43 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-94d83b70-1983-428f-a2de-5eae38d037e4 tempest-GroupsV320Test-518704721 None] Create group completed successfully. Feb 27 02:03:43 devstack sudo[83847]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7" returned: 0 in 0.745s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:43 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:43 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50440cd-a6aa-4228-bb37-b729b50365d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:43 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1549f3ed-793c-479b-9bb5-0a390e50091c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:43 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Volume volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7 (2a089c66-1b5f-45c3-bc15-6cc82164c3e7): created successfully Feb 27 02:03:43 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1549f3ed-793c-479b-9bb5-0a390e50091c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:43 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Flow 'volume_create_manager' (9712bc43-0f37-4865-a83f-39d8da50e320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:43 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-be19fe64-ac2c-4bf2-ba59-909e70989405 tempest-GroupSnapshotsTest-1373289962 None] Created volume successfully. Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Flow 'volume_create_manager' (b0a5b5e0-0976-46af-ab41-e2ea095df9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56753036-1239-4026-abd2-6f5281471e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56753036-1239-4026-abd2-6f5281471e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1922109905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f480c011-64dc-42e3-ab93-d3176a75573a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2db2b49cc542868dc1dc3d980a6aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:44Z,use_quota=True,user_id='a239b04b70ab4bb09811650bcfb3c77c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ec6209-d98e-44ac-b355-07db185d19f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ec6209-d98e-44ac-b355-07db185d19f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3aba4e-4cc1-487a-9d48-208ae258cfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3aba4e-4cc1-487a-9d48-208ae258cfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f480c011-64dc-42e3-ab93-d3176a75573a', 'volume_name': 'volume-f480c011-64dc-42e3-ab93-d3176a75573a', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88d6052-25b3-4053-af71-3a8185ede220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88d6052-25b3-4053-af71-3a8185ede220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc54d30-331d-4e09-8970-812055aa385c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:44 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Volume f480c011-64dc-42e3-ab93-d3176a75573a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f480c011-64dc-42e3-ab93-d3176a75573a', 'volume_size': 1} Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1922109905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f480c011-64dc-42e3-ab93-d3176a75573a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2db2b49cc542868dc1dc3d980a6aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:44Z,use_quota=True,user_id='a239b04b70ab4bb09811650bcfb3c77c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Creating volume f480c011-64dc-42e3-ab93-d3176a75573a {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:44 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:03:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f480c011-64dc-42e3-ab93-d3176a75573a 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:44 devstack sudo[83850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f480c011-64dc-42e3-ab93-d3176a75573a 1073741824 Feb 27 02:03:44 devstack sudo[83850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:45 devstack sudo[83850]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f480c011-64dc-42e3-ab93-d3176a75573a 1073741824" returned: 0 in 0.791s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f480c011-64dc-42e3-ab93-d3176a75573a {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:45 devstack sudo[83856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f480c011-64dc-42e3-ab93-d3176a75573a Feb 27 02:03:45 devstack sudo[83856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-7f658753-7d1b-4de2-b51f-513c46415c14 tempest-GroupsV320Test-518704721 None] Created reservations ['77db993c-7cba-4a49-b6d9-aff4fc1a3ffe'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7f658753-7d1b-4de2-b51f-513c46415c14 tempest-GroupsV320Test-518704721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7f658753-7d1b-4de2-b51f-513c46415c14 tempest-GroupsV320Test-518704721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7f658753-7d1b-4de2-b51f-513c46415c14 tempest-GroupsV320Test-518704721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7f658753-7d1b-4de2-b51f-513c46415c14 tempest-GroupsV320Test-518704721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7f658753-7d1b-4de2-b51f-513c46415c14 tempest-GroupsV320Test-518704721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7f658753-7d1b-4de2-b51f-513c46415c14 tempest-GroupsV320Test-518704721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:45 devstack sudo[83858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:03:45 devstack sudo[83858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Flow 'volume_create_manager' (4b9106ba-2b1c-4f3b-ba57-c3c15c616e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f4088d-0f7c-440d-9076-5ecec3255f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f4088d-0f7c-440d-9076-5ecec3255f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1475329463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ce693091-f814-4852-ac84-180e905557ae,host='devstack@QuobyteHD#QuobyteHD',id=c6318ab1-2db2-4e7e-b489-761b16563a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4144072e72a477496da42b51d209d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:46Z,use_quota=True,user_id='f798e30bfbf444b78fec652125d8d88d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a003afe-6965-4a13-84bd-b1970bbf5922),volume_type_id=1a003afe-6965-4a13-84bd-b1970bbf5922)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0c50e4-b7c8-4756-a78e-97677aa95bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0c50e4-b7c8-4756-a78e-97677aa95bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0d089d-e53c-4495-ae4b-4c34fe32ff09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0d089d-e53c-4495-ae4b-4c34fe32ff09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6318ab1-2db2-4e7e-b489-761b16563a41', 'volume_name': 'volume-c6318ab1-2db2-4e7e-b489-761b16563a41', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47eb9d10-3377-4a9a-8739-b77d26fb46f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47eb9d10-3377-4a9a-8739-b77d26fb46f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6b0854-545c-4b94-8aa0-690d814298a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:45 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Volume c6318ab1-2db2-4e7e-b489-761b16563a41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6318ab1-2db2-4e7e-b489-761b16563a41', 'volume_size': 1} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:45 devstack sudo[83856]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f480c011-64dc-42e3-ab93-d3176a75573a" returned: 0 in 0.869s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.122s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ce693091-f814-4852-ac84-180e905557ae,created_at=2026-02-27T01:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1475329463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ce693091-f814-4852-ac84-180e905557ae,host='devstack@QuobyteHD#QuobyteHD',id=c6318ab1-2db2-4e7e-b489-761b16563a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4144072e72a477496da42b51d209d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:46Z,use_quota=True,user_id='f798e30bfbf444b78fec652125d8d88d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a003afe-6965-4a13-84bd-b1970bbf5922),volume_type_id=1a003afe-6965-4a13-84bd-b1970bbf5922)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Creating volume c6318ab1-2db2-4e7e-b489-761b16563a41 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:45 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:03:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:46 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc54d30-331d-4e09-8970-812055aa385c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f480c011-64dc-42e3-ab93-d3176a75573a', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:46 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11fc8460-856e-40d5-b7ad-62c4cd208eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:46 devstack sudo[83861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41 1073741824 Feb 27 02:03:46 devstack sudo[83861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:46 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Volume volume-f480c011-64dc-42e3-ab93-d3176a75573a (f480c011-64dc-42e3-ab93-d3176a75573a): created successfully Feb 27 02:03:46 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11fc8460-856e-40d5-b7ad-62c4cd208eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:46 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Flow 'volume_create_manager' (b0a5b5e0-0976-46af-ab41-e2ea095df9a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:46 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-036b5927-2a4f-4558-ad1d-af4780f78c2b tempest-ServersNegativeTestJSON-191337519 None] Created volume successfully. Feb 27 02:03:46 devstack sudo[83858]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7f658753-7d1b-4de2-b51f-513c46415c14 tempest-GroupsV320Test-518704721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.752s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:46 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-7f658753-7d1b-4de2-b51f-513c46415c14 tempest-GroupsV320Test-518704721 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:46 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-7f658753-7d1b-4de2-b51f-513c46415c14 tempest-GroupsV320Test-518704721 None] Delete group completed successfully. Feb 27 02:03:46 devstack sudo[83861]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41 1073741824" returned: 0 in 0.978s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:47 devstack sudo[83867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41 Feb 27 02:03:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-90604ae4-ff09-43c1-ae0c-b4a4e5be8d4b tempest-ServersNegativeTestJSON-191337519 None] Acquiring lock "cinder-f480c011-64dc-42e3-ab93-d3176a75573a-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:47 devstack sudo[83867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-90604ae4-ff09-43c1-ae0c-b4a4e5be8d4b tempest-ServersNegativeTestJSON-191337519 None] Lock "cinder-f480c011-64dc-42e3-ab93-d3176a75573a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-90604ae4-ff09-43c1-ae0c-b4a4e5be8d4b tempest-ServersNegativeTestJSON-191337519 None] Acquiring lock "cinder-quobyte-f480c011-64dc-42e3-ab93-d3176a75573a" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-90604ae4-ff09-43c1-ae0c-b4a4e5be8d4b tempest-ServersNegativeTestJSON-191337519 None] Lock "cinder-quobyte-f480c011-64dc-42e3-ab93-d3176a75573a" acquired by "delete_volume" :: waited 0.023s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:47 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c2a372-e2d7-4e5d-a948-f3391f783ebc]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90604ae4-ff09-43c1-ae0c-b4a4e5be8d4b tempest-ServersNegativeTestJSON-191337519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f480c011-64dc-42e3-ab93-d3176a75573a {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:47 devstack sudo[83869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f480c011-64dc-42e3-ab93-d3176a75573a Feb 27 02:03:47 devstack sudo[83869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:47 devstack sudo[83869]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90604ae4-ff09-43c1-ae0c-b4a4e5be8d4b tempest-ServersNegativeTestJSON-191337519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f480c011-64dc-42e3-ab93-d3176a75573a" returned: 0 in 0.712s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90604ae4-ff09-43c1-ae0c-b4a4e5be8d4b tempest-ServersNegativeTestJSON-191337519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f480c011-64dc-42e3-ab93-d3176a75573a {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:48 devstack sudo[83867]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:48 devstack sudo[83875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f480c011-64dc-42e3-ab93-d3176a75573a Feb 27 02:03:48 devstack sudo[83875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41" returned: 0 in 1.040s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:48 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6b0854-545c-4b94-8aa0-690d814298a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6318ab1-2db2-4e7e-b489-761b16563a41', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07e25f3-32c7-472c-a516-5f40ed85e8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:48 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Volume volume-c6318ab1-2db2-4e7e-b489-761b16563a41 (c6318ab1-2db2-4e7e-b489-761b16563a41): created successfully Feb 27 02:03:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07e25f3-32c7-472c-a516-5f40ed85e8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Flow 'volume_create_manager' (4b9106ba-2b1c-4f3b-ba57-c3c15c616e48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:48 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-2adce78b-01a9-4c33-b299-9100d590df0c tempest-GroupSnapshotsTest-1373289962 None] Created volume successfully. Feb 27 02:03:48 devstack sudo[83875]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90604ae4-ff09-43c1-ae0c-b4a4e5be8d4b tempest-ServersNegativeTestJSON-191337519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f480c011-64dc-42e3-ab93-d3176a75573a" returned: 0 in 0.696s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:48 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-90604ae4-ff09-43c1-ae0c-b4a4e5be8d4b tempest-ServersNegativeTestJSON-191337519 None] Lock "cinder-quobyte-f480c011-64dc-42e3-ab93-d3176a75573a" released by "delete_volume" :: held 1.474s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:48 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-90604ae4-ff09-43c1-ae0c-b4a4e5be8d4b tempest-ServersNegativeTestJSON-191337519 None] Created reservations ['2c8a912a-696a-4127-a739-3ce794f1edd2', 'fdf2258f-cd40-4933-8dd8-5043b3cb49f8', '3d6be08f-6f97-4791-ac70-a8d7b88a446d', '40a4efa2-ccab-4bcd-b0ec-6defbc01672d'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-90604ae4-ff09-43c1-ae0c-b4a4e5be8d4b tempest-ServersNegativeTestJSON-191337519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-90604ae4-ff09-43c1-ae0c-b4a4e5be8d4b tempest-ServersNegativeTestJSON-191337519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:48 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-90604ae4-ff09-43c1-ae0c-b4a4e5be8d4b tempest-ServersNegativeTestJSON-191337519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:48 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-90604ae4-ff09-43c1-ae0c-b4a4e5be8d4b tempest-ServersNegativeTestJSON-191337519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-90604ae4-ff09-43c1-ae0c-b4a4e5be8d4b tempest-ServersNegativeTestJSON-191337519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90604ae4-ff09-43c1-ae0c-b4a4e5be8d4b tempest-ServersNegativeTestJSON-191337519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:48 devstack sudo[83879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:03:48 devstack sudo[83879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:49 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-557f538b-ae1f-44df-b0c4-7382d7d5ce7a tempest-GroupSnapshotsTest-1373289962 None] Update group completed successfully. Feb 27 02:03:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0aef1a84-9b76-4a9b-ac6d-cd7657b16b8d tempest-ServersNegativeTestJSON-191337519 None] Acquiring lock "cinder-6f57bc40-3e8d-4768-abdf-7329a0ffe19f-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0aef1a84-9b76-4a9b-ac6d-cd7657b16b8d tempest-ServersNegativeTestJSON-191337519 None] Lock "cinder-6f57bc40-3e8d-4768-abdf-7329a0ffe19f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:49 devstack sudo[83879]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0aef1a84-9b76-4a9b-ac6d-cd7657b16b8d tempest-ServersNegativeTestJSON-191337519 None] Acquiring lock "cinder-quobyte-6f57bc40-3e8d-4768-abdf-7329a0ffe19f" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90604ae4-ff09-43c1-ae0c-b4a4e5be8d4b tempest-ServersNegativeTestJSON-191337519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.629s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:49 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-90604ae4-ff09-43c1-ae0c-b4a4e5be8d4b tempest-ServersNegativeTestJSON-191337519 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:49 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-90604ae4-ff09-43c1-ae0c-b4a4e5be8d4b tempest-ServersNegativeTestJSON-191337519 None] Deleted volume successfully. Feb 27 02:03:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0aef1a84-9b76-4a9b-ac6d-cd7657b16b8d tempest-ServersNegativeTestJSON-191337519 None] Lock "cinder-quobyte-6f57bc40-3e8d-4768-abdf-7329a0ffe19f" acquired by "delete_volume" :: waited 0.050s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-90604ae4-ff09-43c1-ae0c-b4a4e5be8d4b tempest-ServersNegativeTestJSON-191337519 None] Lock "cinder-f480c011-64dc-42e3-ab93-d3176a75573a-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:49 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b25dd8-9f0f-4b36-b2a8-c42171643256]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0aef1a84-9b76-4a9b-ac6d-cd7657b16b8d tempest-ServersNegativeTestJSON-191337519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f57bc40-3e8d-4768-abdf-7329a0ffe19f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:49 devstack sudo[83882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f57bc40-3e8d-4768-abdf-7329a0ffe19f Feb 27 02:03:49 devstack sudo[83882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:50 devstack sudo[83882]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0aef1a84-9b76-4a9b-ac6d-cd7657b16b8d tempest-ServersNegativeTestJSON-191337519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f57bc40-3e8d-4768-abdf-7329a0ffe19f" returned: 0 in 0.629s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0aef1a84-9b76-4a9b-ac6d-cd7657b16b8d tempest-ServersNegativeTestJSON-191337519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f57bc40-3e8d-4768-abdf-7329a0ffe19f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:50 devstack sudo[83887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f57bc40-3e8d-4768-abdf-7329a0ffe19f Feb 27 02:03:50 devstack sudo[83887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:50 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-c8459c2c-3b0f-4322-b048-fd7efcd7331d tempest-GroupSnapshotsTest-1373289962 None] Update group completed successfully. Feb 27 02:03:51 devstack sudo[83887]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0aef1a84-9b76-4a9b-ac6d-cd7657b16b8d tempest-ServersNegativeTestJSON-191337519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f57bc40-3e8d-4768-abdf-7329a0ffe19f" returned: 0 in 0.827s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:51 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0aef1a84-9b76-4a9b-ac6d-cd7657b16b8d tempest-ServersNegativeTestJSON-191337519 None] Lock "cinder-quobyte-6f57bc40-3e8d-4768-abdf-7329a0ffe19f" released by "delete_volume" :: held 1.499s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:51 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-0aef1a84-9b76-4a9b-ac6d-cd7657b16b8d tempest-ServersNegativeTestJSON-191337519 None] Created reservations ['e3b440cc-39fe-438f-b53c-da64db66e7ad', 'a2056e81-1440-4d6b-a9c4-46f5088799ec', '5767481c-91fc-4b93-b984-d030b43104ce', '81a2d874-2185-47aa-b3a8-5471253dc44b'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0aef1a84-9b76-4a9b-ac6d-cd7657b16b8d tempest-ServersNegativeTestJSON-191337519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0aef1a84-9b76-4a9b-ac6d-cd7657b16b8d tempest-ServersNegativeTestJSON-191337519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0aef1a84-9b76-4a9b-ac6d-cd7657b16b8d tempest-ServersNegativeTestJSON-191337519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0aef1a84-9b76-4a9b-ac6d-cd7657b16b8d tempest-ServersNegativeTestJSON-191337519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0aef1a84-9b76-4a9b-ac6d-cd7657b16b8d tempest-ServersNegativeTestJSON-191337519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0aef1a84-9b76-4a9b-ac6d-cd7657b16b8d tempest-ServersNegativeTestJSON-191337519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:51 devstack sudo[83891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:03:51 devstack sudo[83891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:51 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=132,cinder:UPDATE=133,cinder:INSERT=30,cinder:DELETE=6 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:03:51 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-34b16e1b-9a48-4836-ae7c-ac4450a91396 tempest-GroupSnapshotsTest-1373289962 None] Update group completed successfully. Feb 27 02:03:51 devstack sudo[83891]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0aef1a84-9b76-4a9b-ac6d-cd7657b16b8d tempest-ServersNegativeTestJSON-191337519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.803s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:51 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-0aef1a84-9b76-4a9b-ac6d-cd7657b16b8d tempest-ServersNegativeTestJSON-191337519 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:52 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-0aef1a84-9b76-4a9b-ac6d-cd7657b16b8d tempest-ServersNegativeTestJSON-191337519 None] Deleted volume successfully. Feb 27 02:03:52 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0aef1a84-9b76-4a9b-ac6d-cd7657b16b8d tempest-ServersNegativeTestJSON-191337519 None] Lock "cinder-6f57bc40-3e8d-4768-abdf-7329a0ffe19f-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:53 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-298d1b59-f3e9-46ea-b70c-77953a8e951c tempest-GroupSnapshotsTest-1373289962 None] Update group completed successfully. Feb 27 02:03:54 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] GroupSnapshot 319564fb-f5be-4950-a0ec-ad2bd286d246: creating. Feb 27 02:03:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Group snapshot 319564fb-f5be-4950-a0ec-ad2bd286d246: creating. {{(pid=82738) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 02:03:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Creating offline snapshot 0f350a89-d265-4143-92ea-f8bf4b583b54 of volume 2a089c66-1b5f-45c3-bc15-6cc82164c3e7 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:03:54 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[541dbcb3-2693-4c74-81e1-9d6272bd9ed2]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:54 devstack sudo[83917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7 Feb 27 02:03:54 devstack sudo[83917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:55 devstack sudo[83917]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7" returned: 0 in 0.767s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.0f350a89-d265-4143-92ea-f8bf4b583b54 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:55 devstack sudo[83923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.0f350a89-d265-4143-92ea-f8bf4b583b54 1G Feb 27 02:03:55 devstack sudo[83923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:56 devstack sudo[83923]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.0f350a89-d265-4143-92ea-f8bf4b583b54 1G" returned: 0 in 0.758s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.0f350a89-d265-4143-92ea-f8bf4b583b54 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:56 devstack sudo[83928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.0f350a89-d265-4143-92ea-f8bf4b583b54 Feb 27 02:03:56 devstack sudo[83928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:57 devstack sudo[83928]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.0f350a89-d265-4143-92ea-f8bf4b583b54" returned: 0 in 0.783s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:57 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.0f350a89-d265-4143-92ea-f8bf4b583b54 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:03:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.0f350a89-d265-4143-92ea-f8bf4b583b54 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:57 devstack sudo[83936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.0f350a89-d265-4143-92ea-f8bf4b583b54 Feb 27 02:03:57 devstack sudo[83936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:57 devstack sudo[83936]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.0f350a89-d265-4143-92ea-f8bf4b583b54" returned: 0 in 0.628s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:57 devstack sudo[83939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.info Feb 27 02:03:57 devstack sudo[83939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:58 devstack sudo[83939]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.info" returned: 0 in 0.577s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:58 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:03:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:58 devstack sudo[83942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.info Feb 27 02:03:58 devstack sudo[83942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:58 devstack sudo[83942]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.info" returned: 0 in 0.566s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.158s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Creating offline snapshot a28d2f74-42f1-498f-b16b-88b2d8653899 of volume c6318ab1-2db2-4e7e-b489-761b16563a41 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:03:59 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c592600-f0b4-4cf2-8c3f-c7de7d4af8c0]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:59 devstack sudo[83945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41 Feb 27 02:03:59 devstack sudo[83945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:59 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Flow 'volume_create_manager' (ef717b26-db3f-47c3-b539-61bb2968f92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c79c69c-5d94-4329-a34c-21aa2e3765d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c79c69c-5d94-4329-a34c-21aa2e3765d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-487420855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e684042c3e90433ebe2bd1b3027266ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:59Z,use_quota=True,user_id='6e618e169fa24e74ad2ce912b81ce87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc161473-a5ba-425d-a7cb-c3c91ab2331a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc161473-a5ba-425d-a7cb-c3c91ab2331a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67c207a-eb20-440f-97ae-7366254ec166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67c207a-eb20-440f-97ae-7366254ec166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c', 'volume_name': 'volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe66edc7-937d-47fe-b6e2-20b625655eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe66edc7-937d-47fe-b6e2-20b625655eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3f7a6d-3236-4cf8-9fe8-0f2994054072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:59 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Volume cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c', 'volume_size': 1} Feb 27 02:03:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:59 devstack sudo[83945]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41" returned: 0 in 0.673s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.a28d2f74-42f1-498f-b16b-88b2d8653899 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:59 devstack sudo[83950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.a28d2f74-42f1-498f-b16b-88b2d8653899 1G Feb 27 02:03:59 devstack sudo[83950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:00 devstack sudo[83950]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.a28d2f74-42f1-498f-b16b-88b2d8653899 1G" returned: 0 in 0.707s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6318ab1-2db2-4e7e-b489-761b16563a41 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.a28d2f74-42f1-498f-b16b-88b2d8653899 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:00 devstack sudo[83957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6318ab1-2db2-4e7e-b489-761b16563a41 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.a28d2f74-42f1-498f-b16b-88b2d8653899 Feb 27 02:04:00 devstack sudo[83957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:00 devstack sudo[83957]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6318ab1-2db2-4e7e-b489-761b16563a41 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.a28d2f74-42f1-498f-b16b-88b2d8653899" returned: 0 in 0.566s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:01 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.a28d2f74-42f1-498f-b16b-88b2d8653899 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:04:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.a28d2f74-42f1-498f-b16b-88b2d8653899 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:01 devstack sudo[83962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.a28d2f74-42f1-498f-b16b-88b2d8653899 Feb 27 02:04:01 devstack sudo[83962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:01 devstack sudo[83962]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.a28d2f74-42f1-498f-b16b-88b2d8653899" returned: 0 in 0.612s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:01 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=117,cinder:UPDATE=122,cinder:INSERT=22,cinder:DELETE=6 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:04:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:01 devstack sudo[83965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.info Feb 27 02:04:01 devstack sudo[83965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:02 devstack sudo[83965]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.info" returned: 0 in 0.771s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:02 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:04:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:02 devstack sudo[83968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.info Feb 27 02:04:02 devstack sudo[83968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:02 devstack sudo[83968]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.info" returned: 0 in 0.584s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.020s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.540s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-487420855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e684042c3e90433ebe2bd1b3027266ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:59Z,use_quota=True,user_id='6e618e169fa24e74ad2ce912b81ce87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Creating volume cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:03 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:04:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:03 devstack sudo[83973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c 1073741824 Feb 27 02:04:03 devstack sudo[83973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:03 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-0cac89ee-18f2-419a-9fba-19edd49658f3 tempest-GroupSnapshotsTest-1373289962 None] group_snapshot 319564fb-f5be-4950-a0ec-ad2bd286d246: created successfully Feb 27 02:04:04 devstack sudo[83973]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c 1073741824" returned: 0 in 0.983s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:04 devstack sudo[83994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c Feb 27 02:04:04 devstack sudo[83994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:04 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] group_snapshot 319564fb-f5be-4950-a0ec-ad2bd286d246: deleting Feb 27 02:04:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] group_snapshot 319564fb-f5be-4950-a0ec-ad2bd286d246: deleting {{(pid=82738) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 02:04:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "cinder-quobyte-2a089c66-1b5f-45c3-bc15-6cc82164c3e7" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-2a089c66-1b5f-45c3-bc15-6cc82164c3e7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "cinder-quobyte-0f350a89-d265-4143-92ea-f8bf4b583b54" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-0f350a89-d265-4143-92ea-f8bf4b583b54" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Deleting offline snapshot 0f350a89-d265-4143-92ea-f8bf4b583b54 of volume 2a089c66-1b5f-45c3-bc15-6cc82164c3e7 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:04:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] snapshot_file for this snap is: volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.0f350a89-d265-4143-92ea-f8bf4b583b54 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:04:04 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7946890-a7ac-4e82-ac3d-5e4b05a10ad0]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.0f350a89-d265-4143-92ea-f8bf4b583b54 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:04 devstack sudo[83994]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" returned: 0 in 0.758s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3f7a6d-3236-4cf8-9fe8-0f2994054072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:04 devstack sudo[83997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.0f350a89-d265-4143-92ea-f8bf4b583b54 Feb 27 02:04:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ee7375-b60f-4131-b555-032fe4ff5c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:04 devstack sudo[83997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:04 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Volume volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c (cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c): created successfully Feb 27 02:04:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ee7375-b60f-4131-b555-032fe4ff5c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Flow 'volume_create_manager' (ef717b26-db3f-47c3-b539-61bb2968f92c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:04 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-ce6bd4a7-8816-442a-9e1c-462aa0a8a7d5 tempest-SnapshotsActionsTest-982775048 None] Created volume successfully. Feb 27 02:04:05 devstack sudo[83997]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.0f350a89-d265-4143-92ea-f8bf4b583b54" returned: 0 in 0.676s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:05 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:05 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[e751ba9b-98d2-43da-9e37-ba107b4122a1]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:05 devstack sudo[84002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7 Feb 27 02:04:05 devstack sudo[84002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:06 devstack sudo[84002]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7" returned: 0 in 0.660s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.0f350a89-d265-4143-92ea-f8bf4b583b54 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:06 devstack sudo[84007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.0f350a89-d265-4143-92ea-f8bf4b583b54 Feb 27 02:04:06 devstack sudo[84007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Flow 'volume_create_manager' (0af24fba-7f20-495c-90b3-4e4826f954d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810bb54c-6659-4e3e-8314-991b091a9975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810bb54c-6659-4e3e-8314-991b091a9975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-359695930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44da62ae-ffff-48f3-a052-0cc2ecdb64e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee9a4a06b840485f87f859eff563388c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:06Z,use_quota=True,user_id='a6c027295e0540f78f6676ea8d4cadb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a6c20f-ea36-47d3-8795-dc9f8de114db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a6c20f-ea36-47d3-8795-dc9f8de114db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53902841-1af2-4161-9ade-9684de9fde4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53902841-1af2-4161-9ade-9684de9fde4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44da62ae-ffff-48f3-a052-0cc2ecdb64e5', 'volume_name': 'volume-44da62ae-ffff-48f3-a052-0cc2ecdb64e5', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87732b5e-9edb-43be-817b-0ccc1e6da489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87732b5e-9edb-43be-817b-0ccc1e6da489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff9e3e3-57b7-4125-9c59-d7ec72a3d5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:06 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Volume 44da62ae-ffff-48f3-a052-0cc2ecdb64e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44da62ae-ffff-48f3-a052-0cc2ecdb64e5', 'volume_size': 1} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-359695930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44da62ae-ffff-48f3-a052-0cc2ecdb64e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee9a4a06b840485f87f859eff563388c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:06Z,use_quota=True,user_id='a6c027295e0540f78f6676ea8d4cadb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Creating volume 44da62ae-ffff-48f3-a052-0cc2ecdb64e5 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:06 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-44da62ae-ffff-48f3-a052-0cc2ecdb64e5 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:06 devstack sudo[84010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-44da62ae-ffff-48f3-a052-0cc2ecdb64e5 1073741824 Feb 27 02:04:06 devstack sudo[84010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6804ff78-5a5e-4c05-b287-b7b6f5e21f6a tempest-SnapshotsActionsTest-982775048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:06 devstack sudo[84007]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.0f350a89-d265-4143-92ea-f8bf4b583b54" returned: 0 in 0.653s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.0f350a89-d265-4143-92ea-f8bf4b583b54 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:06 devstack sudo[84015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.0f350a89-d265-4143-92ea-f8bf4b583b54 Feb 27 02:04:06 devstack sudo[84015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:07 devstack sudo[84010]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-44da62ae-ffff-48f3-a052-0cc2ecdb64e5 1073741824" returned: 0 in 0.594s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-44da62ae-ffff-48f3-a052-0cc2ecdb64e5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:07 devstack sudo[84020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-44da62ae-ffff-48f3-a052-0cc2ecdb64e5 Feb 27 02:04:07 devstack sudo[84020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:07 devstack sudo[84015]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7.0f350a89-d265-4143-92ea-f8bf4b583b54" returned: 0 in 0.544s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-0f350a89-d265-4143-92ea-f8bf4b583b54" released by "_delete_snapshot" :: held 2.625s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-2a089c66-1b5f-45c3-bc15-6cc82164c3e7" released by "delete_snapshot" :: held 2.670s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "cinder-quobyte-c6318ab1-2db2-4e7e-b489-761b16563a41" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-c6318ab1-2db2-4e7e-b489-761b16563a41" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "cinder-quobyte-a28d2f74-42f1-498f-b16b-88b2d8653899" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-a28d2f74-42f1-498f-b16b-88b2d8653899" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Deleting offline snapshot a28d2f74-42f1-498f-b16b-88b2d8653899 of volume c6318ab1-2db2-4e7e-b489-761b16563a41 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] snapshot_file for this snap is: volume-c6318ab1-2db2-4e7e-b489-761b16563a41.a28d2f74-42f1-498f-b16b-88b2d8653899 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[77177b4b-72ca-43d8-9d5e-8961786d8348]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.a28d2f74-42f1-498f-b16b-88b2d8653899 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:07 devstack sudo[84023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.a28d2f74-42f1-498f-b16b-88b2d8653899 Feb 27 02:04:07 devstack sudo[84023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:07 devstack sudo[84020]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-44da62ae-ffff-48f3-a052-0cc2ecdb64e5" returned: 0 in 0.589s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6804ff78-5a5e-4c05-b287-b7b6f5e21f6a tempest-SnapshotsActionsTest-982775048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.185s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-6804ff78-5a5e-4c05-b287-b7b6f5e21f6a tempest-SnapshotsActionsTest-982775048 None] Creating offline snapshot ff87a37e-3687-4528-baaf-92b0f77e10d2 of volume cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff9e3e3-57b7-4125-9c59-d7ec72a3d5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44da62ae-ffff-48f3-a052-0cc2ecdb64e5', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e205b8a-f36a-49e1-8639-4acc2ecd2366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[026aa836-d779-4dc1-84df-11680f7febe2]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6804ff78-5a5e-4c05-b287-b7b6f5e21f6a tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:07 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Volume volume-44da62ae-ffff-48f3-a052-0cc2ecdb64e5 (44da62ae-ffff-48f3-a052-0cc2ecdb64e5): created successfully Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e205b8a-f36a-49e1-8639-4acc2ecd2366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Flow 'volume_create_manager' (0af24fba-7f20-495c-90b3-4e4826f954d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:07 devstack cinder-volume[82738]: INFO cinder.volume.manager [req-1560c55a-bbb8-45a1-b1e6-5bd26c363d3a req-2ffcfc1e-caa3-495f-8849-ef48487c716d tempest-VolumesGetTestJSON-1799448208 None] Created volume successfully. Feb 27 02:04:07 devstack sudo[84029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c Feb 27 02:04:07 devstack sudo[84029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:07 devstack sudo[84023]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.a28d2f74-42f1-498f-b16b-88b2d8653899" returned: 0 in 0.594s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6318ab1-2db2-4e7e-b489-761b16563a41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb7140b-a49f-4e5a-b910-eed7d7bb2e42]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:08 devstack sudo[84034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41 Feb 27 02:04:08 devstack sudo[84034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:08 devstack sudo[84029]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6804ff78-5a5e-4c05-b287-b7b6f5e21f6a tempest-SnapshotsActionsTest-982775048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" returned: 0 in 0.631s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6804ff78-5a5e-4c05-b287-b7b6f5e21f6a tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:08 devstack sudo[84041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 1G Feb 27 02:04:08 devstack sudo[84041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:08 devstack sudo[84034]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41" returned: 0 in 0.609s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.a28d2f74-42f1-498f-b16b-88b2d8653899 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:08 devstack sudo[84046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.a28d2f74-42f1-498f-b16b-88b2d8653899 Feb 27 02:04:08 devstack sudo[84046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-d8c4892c-b2e5-458b-abe1-a05e82977dad req-a26c8aaa-c127-4fe1-986d-4021244fd55e tempest-VolumesGetTestJSON-1799448208 None] Acquiring lock "cinder-44da62ae-ffff-48f3-a052-0cc2ecdb64e5-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-d8c4892c-b2e5-458b-abe1-a05e82977dad req-a26c8aaa-c127-4fe1-986d-4021244fd55e tempest-VolumesGetTestJSON-1799448208 None] Lock "cinder-44da62ae-ffff-48f3-a052-0cc2ecdb64e5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-d8c4892c-b2e5-458b-abe1-a05e82977dad req-a26c8aaa-c127-4fe1-986d-4021244fd55e tempest-VolumesGetTestJSON-1799448208 None] Acquiring lock "cinder-quobyte-44da62ae-ffff-48f3-a052-0cc2ecdb64e5" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-d8c4892c-b2e5-458b-abe1-a05e82977dad req-a26c8aaa-c127-4fe1-986d-4021244fd55e tempest-VolumesGetTestJSON-1799448208 None] Lock "cinder-quobyte-44da62ae-ffff-48f3-a052-0cc2ecdb64e5" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:08 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9ca20c-daad-4d11-b53f-e6608dba3487]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-d8c4892c-b2e5-458b-abe1-a05e82977dad req-a26c8aaa-c127-4fe1-986d-4021244fd55e tempest-VolumesGetTestJSON-1799448208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-44da62ae-ffff-48f3-a052-0cc2ecdb64e5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:08 devstack sudo[84048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-44da62ae-ffff-48f3-a052-0cc2ecdb64e5 Feb 27 02:04:08 devstack sudo[84048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:08 devstack sudo[84041]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6804ff78-5a5e-4c05-b287-b7b6f5e21f6a tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 1G" returned: 0 in 0.666s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6804ff78-5a5e-4c05-b287-b7b6f5e21f6a tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:08 devstack sudo[84053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 Feb 27 02:04:08 devstack sudo[84053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:09 devstack sudo[84046]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.a28d2f74-42f1-498f-b16b-88b2d8653899" returned: 0 in 0.767s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.a28d2f74-42f1-498f-b16b-88b2d8653899 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:09 devstack sudo[84084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.a28d2f74-42f1-498f-b16b-88b2d8653899 Feb 27 02:04:09 devstack sudo[84084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:09 devstack sudo[84048]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-d8c4892c-b2e5-458b-abe1-a05e82977dad req-a26c8aaa-c127-4fe1-986d-4021244fd55e tempest-VolumesGetTestJSON-1799448208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-44da62ae-ffff-48f3-a052-0cc2ecdb64e5" returned: 0 in 0.919s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-d8c4892c-b2e5-458b-abe1-a05e82977dad req-a26c8aaa-c127-4fe1-986d-4021244fd55e tempest-VolumesGetTestJSON-1799448208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-44da62ae-ffff-48f3-a052-0cc2ecdb64e5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:09 devstack sudo[84089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-44da62ae-ffff-48f3-a052-0cc2ecdb64e5 Feb 27 02:04:09 devstack sudo[84089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:09 devstack sudo[84053]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6804ff78-5a5e-4c05-b287-b7b6f5e21f6a tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2" returned: 0 in 0.939s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:09 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-6804ff78-5a5e-4c05-b287-b7b6f5e21f6a tempest-SnapshotsActionsTest-982775048 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 is being set with open permissions: ugo+rw Feb 27 02:04:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6804ff78-5a5e-4c05-b287-b7b6f5e21f6a tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:09 devstack sudo[84094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 Feb 27 02:04:09 devstack sudo[84094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:10 devstack sudo[84084]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41.a28d2f74-42f1-498f-b16b-88b2d8653899" returned: 0 in 0.927s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:10 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-a28d2f74-42f1-498f-b16b-88b2d8653899" released by "_delete_snapshot" :: held 2.981s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:10 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-c6318ab1-2db2-4e7e-b489-761b16563a41" released by "delete_snapshot" :: held 3.000s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:10 devstack cinder-volume[82738]: WARNING cinder.quota [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1830033589 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1830033589, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:04:10 devstack cinder-volume[82738]: WARNING cinder.quota [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1830033589 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1830033589, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:04:10 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Created reservations ['a0a9a2a1-9cc9-4fcb-80db-4009ab8304af', 'ee49e904-f7d0-483d-8ef1-c23629b030e4', '22b37633-0e2c-4050-81df-f43ade034f8c', '5a2eeb70-ebe1-41bb-8994-3855c5af14a3'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:10 devstack sudo[84089]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-d8c4892c-b2e5-458b-abe1-a05e82977dad req-a26c8aaa-c127-4fe1-986d-4021244fd55e tempest-VolumesGetTestJSON-1799448208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-44da62ae-ffff-48f3-a052-0cc2ecdb64e5" returned: 0 in 0.944s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:10 devstack sudo[84094]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6804ff78-5a5e-4c05-b287-b7b6f5e21f6a tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2" returned: 0 in 0.694s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:10 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-d8c4892c-b2e5-458b-abe1-a05e82977dad req-a26c8aaa-c127-4fe1-986d-4021244fd55e tempest-VolumesGetTestJSON-1799448208 None] Lock "cinder-quobyte-44da62ae-ffff-48f3-a052-0cc2ecdb64e5" released by "delete_volume" :: held 1.908s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:10 devstack cinder-volume[82738]: DEBUG cinder.quota [req-d8c4892c-b2e5-458b-abe1-a05e82977dad req-a26c8aaa-c127-4fe1-986d-4021244fd55e tempest-VolumesGetTestJSON-1799448208 None] Created reservations ['b4551a25-eb08-4f84-9575-915cdba77314', '3ccf1505-9341-4f03-a837-c9fdd9fdffb0', 'a6aa5db9-b36f-4fb4-920c-e19c81a7cfc0', '6b2c67f7-28f8-42eb-9cec-1b7c6069d40f'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6804ff78-5a5e-4c05-b287-b7b6f5e21f6a tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:10 devstack sudo[84102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.info Feb 27 02:04:10 devstack sudo[84102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:10 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] Created reservations ['6dfeefe5-5009-4506-9905-a76b13146ec4', '97f7b3de-187a-4aad-86aa-91d4a1efd4d8', 'fe36d6b9-6947-4610-9e3d-322937faea60', '6276f3a0-7070-436a-adcb-ea7e8283115c'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-d8c4892c-b2e5-458b-abe1-a05e82977dad req-a26c8aaa-c127-4fe1-986d-4021244fd55e tempest-VolumesGetTestJSON-1799448208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-d8c4892c-b2e5-458b-abe1-a05e82977dad req-a26c8aaa-c127-4fe1-986d-4021244fd55e tempest-VolumesGetTestJSON-1799448208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-d8c4892c-b2e5-458b-abe1-a05e82977dad req-a26c8aaa-c127-4fe1-986d-4021244fd55e tempest-VolumesGetTestJSON-1799448208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-d8c4892c-b2e5-458b-abe1-a05e82977dad req-a26c8aaa-c127-4fe1-986d-4021244fd55e tempest-VolumesGetTestJSON-1799448208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-d8c4892c-b2e5-458b-abe1-a05e82977dad req-a26c8aaa-c127-4fe1-986d-4021244fd55e tempest-VolumesGetTestJSON-1799448208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-d8c4892c-b2e5-458b-abe1-a05e82977dad req-a26c8aaa-c127-4fe1-986d-4021244fd55e tempest-VolumesGetTestJSON-1799448208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:10 devstack sudo[84104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:04:10 devstack sudo[84104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:10 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-41d59edf-cb97-4720-b6dd-fe35456cce0a tempest-GroupSnapshotsTest-1373289962 None] group_snapshot 319564fb-f5be-4950-a0ec-ad2bd286d246: deleted successfully Feb 27 02:04:11 devstack sudo[84102]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6804ff78-5a5e-4c05-b287-b7b6f5e21f6a tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.info" returned: 0 in 0.723s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:11 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-6804ff78-5a5e-4c05-b287-b7b6f5e21f6a tempest-SnapshotsActionsTest-982775048 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.info is being set with open permissions: ugo+rw Feb 27 02:04:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6804ff78-5a5e-4c05-b287-b7b6f5e21f6a tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:11 devstack sudo[84107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.info Feb 27 02:04:11 devstack sudo[84107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:11 devstack sudo[84104]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-d8c4892c-b2e5-458b-abe1-a05e82977dad req-a26c8aaa-c127-4fe1-986d-4021244fd55e tempest-VolumesGetTestJSON-1799448208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.881s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:11 devstack cinder-volume[82738]: DEBUG cinder.manager [req-d8c4892c-b2e5-458b-abe1-a05e82977dad req-a26c8aaa-c127-4fe1-986d-4021244fd55e tempest-VolumesGetTestJSON-1799448208 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:11 devstack cinder-volume[82738]: INFO cinder.volume.manager [req-d8c4892c-b2e5-458b-abe1-a05e82977dad req-a26c8aaa-c127-4fe1-986d-4021244fd55e tempest-VolumesGetTestJSON-1799448208 None] Deleted volume successfully. Feb 27 02:04:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-d8c4892c-b2e5-458b-abe1-a05e82977dad req-a26c8aaa-c127-4fe1-986d-4021244fd55e tempest-VolumesGetTestJSON-1799448208 None] Lock "cinder-44da62ae-ffff-48f3-a052-0cc2ecdb64e5-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "cinder-quobyte-2a089c66-1b5f-45c3-bc15-6cc82164c3e7" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-2a089c66-1b5f-45c3-bc15-6cc82164c3e7" acquired by "delete_volume" :: waited 0.022s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:11 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b4500f-3ed2-45df-9c48-5c95d03f9292]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:12 devstack sudo[84110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7 Feb 27 02:04:12 devstack sudo[84110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:12 devstack sudo[84107]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Flow 'volume_create_manager' (19f951f1-a62c-4a64-9362-38233c6f7f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f7168e-9ba5-4a6b-b4f4-b3da1f745af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6804ff78-5a5e-4c05-b287-b7b6f5e21f6a tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.info" returned: 0 in 0.870s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6804ff78-5a5e-4c05-b287-b7b6f5e21f6a tempest-SnapshotsActionsTest-982775048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.711s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f7168e-9ba5-4a6b-b4f4-b3da1f745af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-523003147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f8389a-fa72-402f-b2cd-5c986e2b8f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db41e8db0ec647b7bc7ed46bb4897bc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:12Z,use_quota=True,user_id='d681b322a299494aa6d9996d5c01cfd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48608e6-d8be-47c0-b486-6c62414751ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48608e6-d8be-47c0-b486-6c62414751ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a2ed77-51eb-4286-969a-3d18638060dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a2ed77-51eb-4286-969a-3d18638060dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5f8389a-fa72-402f-b2cd-5c986e2b8f1f', 'volume_name': 'volume-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06989571-4f55-4523-a82d-3196d1cc7288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06989571-4f55-4523-a82d-3196d1cc7288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33bf0f7-cecb-4999-a9b9-02bc2cf521e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:12 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Volume c5f8389a-fa72-402f-b2cd-5c986e2b8f1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f', 'volume_size': 1} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-523003147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f8389a-fa72-402f-b2cd-5c986e2b8f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db41e8db0ec647b7bc7ed46bb4897bc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:12Z,use_quota=True,user_id='d681b322a299494aa6d9996d5c01cfd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Creating volume c5f8389a-fa72-402f-b2cd-5c986e2b8f1f {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:12 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:12 devstack sudo[84113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f 1073741824 Feb 27 02:04:12 devstack sudo[84113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:12 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-6804ff78-5a5e-4c05-b287-b7b6f5e21f6a tempest-SnapshotsActionsTest-982775048 None] Create snapshot completed successfully Feb 27 02:04:12 devstack sudo[84110]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7" returned: 0 in 0.799s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:12 devstack sudo[84118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7 Feb 27 02:04:12 devstack sudo[84118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:13 devstack sudo[84113]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f 1073741824" returned: 0 in 1.084s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:13 devstack sudo[84118]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2a089c66-1b5f-45c3-bc15-6cc82164c3e7" returned: 0 in 0.824s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-2a089c66-1b5f-45c3-bc15-6cc82164c3e7" released by "delete_volume" :: held 1.691s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "cinder-quobyte-c6318ab1-2db2-4e7e-b489-761b16563a41" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-c6318ab1-2db2-4e7e-b489-761b16563a41" acquired by "delete_volume" :: waited 0.016s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:13 devstack sudo[84125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f Feb 27 02:04:13 devstack sudo[84125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:13 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e0d430-d2f1-4f36-b34a-f11aef8184a4]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:13 devstack sudo[84127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41 Feb 27 02:04:13 devstack sudo[84127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2d507c01-9a65-4d56-9080-b65e7913286b tempest-SnapshotsActionsTest-982775048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:14 devstack sudo[84125]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f" returned: 0 in 0.611s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:14 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2d507c01-9a65-4d56-9080-b65e7913286b tempest-SnapshotsActionsTest-982775048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.301s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:14 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-2d507c01-9a65-4d56-9080-b65e7913286b tempest-SnapshotsActionsTest-982775048 None] Creating offline snapshot bf13c845-16b0-4b54-8d93-f7ebf1fbe05e of volume cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:04:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33bf0f7-cecb-4999-a9b9-02bc2cf521e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93777d4c-aa33-4d16-8d41-5f8247ab479c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:14 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5b1703-d704-4f15-928d-f5090aa7d8fd]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2d507c01-9a65-4d56-9080-b65e7913286b tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:14 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Volume volume-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f (c5f8389a-fa72-402f-b2cd-5c986e2b8f1f): created successfully Feb 27 02:04:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93777d4c-aa33-4d16-8d41-5f8247ab479c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Flow 'volume_create_manager' (19f951f1-a62c-4a64-9362-38233c6f7f3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:14 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-032b2a26-b627-430a-b8bf-73df5ddd7d14 tempest-DeleteServersTestJSON-1368681151 None] Created volume successfully. Feb 27 02:04:14 devstack sudo[84130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 Feb 27 02:04:14 devstack sudo[84130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:14 devstack sudo[84127]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41" returned: 0 in 0.846s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:14 devstack sudo[84135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41 Feb 27 02:04:14 devstack sudo[84135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:14 devstack sudo[84130]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2d507c01-9a65-4d56-9080-b65e7913286b tempest-SnapshotsActionsTest-982775048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2" returned: 0 in 0.704s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:14 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-2d507c01-9a65-4d56-9080-b65e7913286b tempest-SnapshotsActionsTest-982775048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2d507c01-9a65-4d56-9080-b65e7913286b tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.bf13c845-16b0-4b54-8d93-f7ebf1fbe05e 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:15 devstack sudo[84141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.bf13c845-16b0-4b54-8d93-f7ebf1fbe05e 1G Feb 27 02:04:15 devstack sudo[84141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:15 devstack sudo[84135]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c6318ab1-2db2-4e7e-b489-761b16563a41" returned: 0 in 0.567s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-c6318ab1-2db2-4e7e-b489-761b16563a41" released by "delete_volume" :: held 1.465s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Created reservations ['234b861d-7be7-46dd-89f6-1925fb7e03a5'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Flow 'volume_create_manager' (af26c31b-3c39-4d4f-ab66-36e828e5afa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f6fbab-8b03-4853-bde6-760e3e5cbf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f6fbab-8b03-4853-bde6-760e3e5cbf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-815196918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79cdd23-db7d-4c29-b94f-af339d828361,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4def43ea77514869bb45913dc8f8c95e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:15Z,use_quota=True,user_id='fb61599c397641379525563882563fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16e8901-4075-445e-ab1c-4cb75321ba59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16e8901-4075-445e-ab1c-4cb75321ba59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca7b73b-48cb-44af-b57f-447a4afc142f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca7b73b-48cb-44af-b57f-447a4afc142f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e79cdd23-db7d-4c29-b94f-af339d828361', 'volume_name': 'volume-e79cdd23-db7d-4c29-b94f-af339d828361', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea9b0b6-0f03-49a1-b49a-e4d7414cbe4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea9b0b6-0f03-49a1-b49a-e4d7414cbe4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227cde0e-ebf6-4777-a810-e268df71e0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:15 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Volume e79cdd23-db7d-4c29-b94f-af339d828361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e79cdd23-db7d-4c29-b94f-af339d828361', 'volume_size': 1} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:15 devstack cinder-volume[82738]: WARNING cinder.quota [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1830033589 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1830033589, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Created reservations ['4f20feb8-b15b-4182-bbfc-1342ac400fb4', '2a7344f1-6c74-4c8a-a3b7-c6b57f4f1b2e', '18f59cbc-6701-402e-88bb-2349dedb403c', 'b44ef9e2-c331-44f8-b3db-8dcbf26d30c4'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Created reservations ['038314b6-c838-4694-80d3-d35bc4a083c3', 'e1081304-146a-4c5a-83e3-ed02b33fce0f', 'eb22e268-1300-4c62-a3e0-3903585bd75a', '3b105d40-9cbe-40c5-8d7b-d76761d9c487'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:15 devstack sudo[84151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:04:15 devstack sudo[84151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:15 devstack sudo[84141]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2d507c01-9a65-4d56-9080-b65e7913286b tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.bf13c845-16b0-4b54-8d93-f7ebf1fbe05e 1G" returned: 0 in 0.763s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2d507c01-9a65-4d56-9080-b65e7913286b tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.bf13c845-16b0-4b54-8d93-f7ebf1fbe05e {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:15 devstack sudo[84155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.bf13c845-16b0-4b54-8d93-f7ebf1fbe05e Feb 27 02:04:15 devstack sudo[84155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:16 devstack sudo[84151]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.537s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:16 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:16 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-506d7b96-3296-4a1e-a683-c9fb2257a45c tempest-GroupSnapshotsTest-1373289962 None] Delete group completed successfully. Feb 27 02:04:16 devstack sudo[84155]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2d507c01-9a65-4d56-9080-b65e7913286b tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.bf13c845-16b0-4b54-8d93-f7ebf1fbe05e" returned: 0 in 0.523s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:16 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-2d507c01-9a65-4d56-9080-b65e7913286b tempest-SnapshotsActionsTest-982775048 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.bf13c845-16b0-4b54-8d93-f7ebf1fbe05e is being set with open permissions: ugo+rw Feb 27 02:04:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2d507c01-9a65-4d56-9080-b65e7913286b tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.bf13c845-16b0-4b54-8d93-f7ebf1fbe05e {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:16 devstack sudo[84161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.bf13c845-16b0-4b54-8d93-f7ebf1fbe05e Feb 27 02:04:16 devstack sudo[84161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:16 devstack sudo[84161]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2d507c01-9a65-4d56-9080-b65e7913286b tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.bf13c845-16b0-4b54-8d93-f7ebf1fbe05e" returned: 0 in 0.569s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2d507c01-9a65-4d56-9080-b65e7913286b tempest-SnapshotsActionsTest-982775048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.706s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.641s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-815196918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79cdd23-db7d-4c29-b94f-af339d828361,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4def43ea77514869bb45913dc8f8c95e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:15Z,use_quota=True,user_id='fb61599c397641379525563882563fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Creating volume e79cdd23-db7d-4c29-b94f-af339d828361 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:16 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:04:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e79cdd23-db7d-4c29-b94f-af339d828361 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:16 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-1d11f69b-dac4-41da-93b8-3ad45bf0d7ed tempest-GroupSnapshotsTest-1373289962 None] Group tempest-GroupSnapshotsTest-Group-699727068: creating Feb 27 02:04:16 devstack sudo[84198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e79cdd23-db7d-4c29-b94f-af339d828361 1073741824 Feb 27 02:04:16 devstack sudo[84198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:16 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-2d507c01-9a65-4d56-9080-b65e7913286b tempest-SnapshotsActionsTest-982775048 None] Create snapshot completed successfully Feb 27 02:04:16 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-1d11f69b-dac4-41da-93b8-3ad45bf0d7ed tempest-GroupSnapshotsTest-1373289962 None] Group tempest-GroupSnapshotsTest-Group-699727068: created successfully Feb 27 02:04:17 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-1d11f69b-dac4-41da-93b8-3ad45bf0d7ed tempest-GroupSnapshotsTest-1373289962 None] Create group completed successfully. Feb 27 02:04:17 devstack sudo[84198]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e79cdd23-db7d-4c29-b94f-af339d828361 1073741824" returned: 0 in 0.638s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e79cdd23-db7d-4c29-b94f-af339d828361 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:17 devstack sudo[84203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e79cdd23-db7d-4c29-b94f-af339d828361 Feb 27 02:04:17 devstack sudo[84203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:18 devstack sudo[84203]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e79cdd23-db7d-4c29-b94f-af339d828361" returned: 0 in 0.543s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227cde0e-ebf6-4777-a810-e268df71e0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e79cdd23-db7d-4c29-b94f-af339d828361', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a678bc-6195-425e-acca-fac373121c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:18 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Volume volume-e79cdd23-db7d-4c29-b94f-af339d828361 (e79cdd23-db7d-4c29-b94f-af339d828361): created successfully Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a678bc-6195-425e-acca-fac373121c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Flow 'volume_create_manager' (af26c31b-3c39-4d4f-ab66-36e828e5afa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:18 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-739d2de5-ff3f-4d49-8991-1b421eccbdf2 tempest-VolumesTestJSON-1360783439 None] Created volume successfully. Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] Acquiring lock "cinder-bf13c845-16b0-4b54-8d93-f7ebf1fbe05e-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-bf13c845-16b0-4b54-8d93-f7ebf1fbe05e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] Acquiring lock "cinder-quobyte-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-quobyte-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] Acquiring lock "cinder-quobyte-bf13c845-16b0-4b54-8d93-f7ebf1fbe05e" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-quobyte-bf13c845-16b0-4b54-8d93-f7ebf1fbe05e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] Deleting offline snapshot bf13c845-16b0-4b54-8d93-f7ebf1fbe05e of volume cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] snapshot_file for this snap is: volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.bf13c845-16b0-4b54-8d93-f7ebf1fbe05e {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[438f1e3f-ff01-45da-93a2-53ca17e959cb]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.bf13c845-16b0-4b54-8d93-f7ebf1fbe05e {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:18 devstack sudo[84206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.bf13c845-16b0-4b54-8d93-f7ebf1fbe05e Feb 27 02:04:18 devstack sudo[84206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Flow 'volume_create_manager' (8cf2c32d-649d-4877-9515-ef9096f00b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f972fde9-8668-4088-b490-6d4bdaffdfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f972fde9-8668-4088-b490-6d4bdaffdfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-37966211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca837ba8-f88a-4641-8f12-9eeedc333b46,host='devstack@QuobyteHD#QuobyteHD',id=66e5114a-85de-4721-88dd-501d6ccf2a90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4144072e72a477496da42b51d209d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:18Z,use_quota=True,user_id='f798e30bfbf444b78fec652125d8d88d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249db82c-cdaf-4d5d-8292-b11b51732ff6),volume_type_id=249db82c-cdaf-4d5d-8292-b11b51732ff6)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80fd0ac1-6ce6-4f65-8491-9c5c7b0e044b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80fd0ac1-6ce6-4f65-8491-9c5c7b0e044b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88aa39a0-ff79-453e-8901-53bc8b97b633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88aa39a0-ff79-453e-8901-53bc8b97b633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66e5114a-85de-4721-88dd-501d6ccf2a90', 'volume_name': 'volume-66e5114a-85de-4721-88dd-501d6ccf2a90', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eaf2d24-f986-49b7-8e6d-3a38a5a255ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eaf2d24-f986-49b7-8e6d-3a38a5a255ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb930f9-83ad-41a1-8ed7-a76c3bf8997e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:18 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Volume 66e5114a-85de-4721-88dd-501d6ccf2a90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66e5114a-85de-4721-88dd-501d6ccf2a90', 'volume_size': 1} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ca837ba8-f88a-4641-8f12-9eeedc333b46,created_at=2026-02-27T01:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-37966211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca837ba8-f88a-4641-8f12-9eeedc333b46,host='devstack@QuobyteHD#QuobyteHD',id=66e5114a-85de-4721-88dd-501d6ccf2a90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4144072e72a477496da42b51d209d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:18Z,use_quota=True,user_id='f798e30bfbf444b78fec652125d8d88d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249db82c-cdaf-4d5d-8292-b11b51732ff6),volume_type_id=249db82c-cdaf-4d5d-8292-b11b51732ff6)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Creating volume 66e5114a-85de-4721-88dd-501d6ccf2a90 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:18 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:18 devstack sudo[84208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90 1073741824 Feb 27 02:04:18 devstack sudo[84208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Flow 'volume_create_manager' (d7f1e5dd-4400-4fde-b06a-5d8b101f4b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7987c2-b33a-4285-bc40-3dffc209ee27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7987c2-b33a-4285-bc40-3dffc209ee27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1233943307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3580b73a-0676-4765-a5c0-dcb410c9b5c4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4def43ea77514869bb45913dc8f8c95e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:19Z,use_quota=True,user_id='fb61599c397641379525563882563fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e86501-b48d-4c8a-8574-f8ba42b9d237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e86501-b48d-4c8a-8574-f8ba42b9d237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5512252-1368-46fb-93b3-8fa6800bc33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5512252-1368-46fb-93b3-8fa6800bc33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3580b73a-0676-4765-a5c0-dcb410c9b5c4', 'volume_name': 'volume-3580b73a-0676-4765-a5c0-dcb410c9b5c4', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17b98c0-456a-4727-98d7-cd465efbfb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17b98c0-456a-4727-98d7-cd465efbfb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd86435-dd10-4c0d-93ca-6535bf860fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:19 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Volume 3580b73a-0676-4765-a5c0-dcb410c9b5c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3580b73a-0676-4765-a5c0-dcb410c9b5c4', 'volume_size': 1} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:19 devstack sudo[84206]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.bf13c845-16b0-4b54-8d93-f7ebf1fbe05e" returned: 0 in 0.770s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a48e7e-656e-4044-b01a-b29935620b25]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:19 devstack sudo[84218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 Feb 27 02:04:19 devstack sudo[84218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:19 devstack sudo[84208]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90 1073741824" returned: 0 in 0.803s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:19 devstack sudo[84221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90 Feb 27 02:04:19 devstack sudo[84221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:19 devstack sudo[84218]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2" returned: 0 in 0.673s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.bf13c845-16b0-4b54-8d93-f7ebf1fbe05e {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:19 devstack sudo[84228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.bf13c845-16b0-4b54-8d93-f7ebf1fbe05e Feb 27 02:04:19 devstack sudo[84228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:19 devstack sudo[84221]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90" returned: 0 in 0.504s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.855s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1233943307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3580b73a-0676-4765-a5c0-dcb410c9b5c4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4def43ea77514869bb45913dc8f8c95e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:19Z,use_quota=True,user_id='fb61599c397641379525563882563fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Creating volume 3580b73a-0676-4765-a5c0-dcb410c9b5c4 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:19 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3580b73a-0676-4765-a5c0-dcb410c9b5c4 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb930f9-83ad-41a1-8ed7-a76c3bf8997e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66e5114a-85de-4721-88dd-501d6ccf2a90', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482664d5-1478-4135-a770-169b6c2ac8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:19 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Volume volume-66e5114a-85de-4721-88dd-501d6ccf2a90 (66e5114a-85de-4721-88dd-501d6ccf2a90): created successfully Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482664d5-1478-4135-a770-169b6c2ac8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:19 devstack sudo[84230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3580b73a-0676-4765-a5c0-dcb410c9b5c4 1073741824 Feb 27 02:04:19 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Flow 'volume_create_manager' (8cf2c32d-649d-4877-9515-ef9096f00b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:19 devstack sudo[84230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:19 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-232a291a-9339-4bd7-9c4f-78f383951b26 tempest-GroupSnapshotsTest-1373289962 None] Created volume successfully. Feb 27 02:04:20 devstack cinder-volume[82738]: WARNING py.warnings [req-c28804c6-993a-46cb-a6b0-c3d715325675 req-106d27a7-da20-4011-9e2a-0eb89b2c924e tempest-DeleteServersTestJSON-1368681151 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Feb 27 02:04:20 devstack cinder-volume[82738]: .first() Feb 27 02:04:20 devstack cinder-volume[82738]: Feb 27 02:04:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-c28804c6-993a-46cb-a6b0-c3d715325675 req-106d27a7-da20-4011-9e2a-0eb89b2c924e tempest-DeleteServersTestJSON-1368681151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:20 devstack sudo[84228]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.bf13c845-16b0-4b54-8d93-f7ebf1fbe05e" returned: 0 in 0.685s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.bf13c845-16b0-4b54-8d93-f7ebf1fbe05e {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:20 devstack sudo[84250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.bf13c845-16b0-4b54-8d93-f7ebf1fbe05e Feb 27 02:04:20 devstack sudo[84250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:20 devstack sudo[84230]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3580b73a-0676-4765-a5c0-dcb410c9b5c4 1073741824" returned: 0 in 0.730s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3580b73a-0676-4765-a5c0-dcb410c9b5c4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:20 devstack sudo[84252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3580b73a-0676-4765-a5c0-dcb410c9b5c4 Feb 27 02:04:20 devstack sudo[84252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:20 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] GroupSnapshot db5bbfd5-5e37-4153-92dc-9098b64bbd4a: creating. Feb 27 02:04:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] Group snapshot db5bbfd5-5e37-4153-92dc-9098b64bbd4a: creating. {{(pid=82738) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 02:04:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:21 devstack sudo[84250]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.bf13c845-16b0-4b54-8d93-f7ebf1fbe05e" returned: 0 in 0.522s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-quobyte-bf13c845-16b0-4b54-8d93-f7ebf1fbe05e" released by "_delete_snapshot" :: held 2.733s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-quobyte-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" released by "delete_snapshot" :: held 2.754s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:21 devstack cinder-volume[82738]: WARNING cinder.quota [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] Created reservations ['2e205ce1-b539-4495-804d-9cdec445f8fa', '88202ad4-4f62-4466-825f-71d3a52126ef', '9810dbd2-10f7-4190-b704-077539a4503b', '00932088-dc32-4b15-bdec-e1ad6736b49b'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:21 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] Delete snapshot completed successfully. Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-dd485bc3-95c7-4eec-9d1b-ee018e229069 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-bf13c845-16b0-4b54-8d93-f7ebf1fbe05e-delete_snapshot" released by "delete_snapshot" :: held 2.882s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:21 devstack sudo[84252]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3580b73a-0676-4765-a5c0-dcb410c9b5c4" returned: 0 in 0.581s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-c28804c6-993a-46cb-a6b0-c3d715325675 req-106d27a7-da20-4011-9e2a-0eb89b2c924e tempest-DeleteServersTestJSON-1368681151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.749s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd86435-dd10-4c0d-93ca-6535bf860fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3580b73a-0676-4765-a5c0-dcb410c9b5c4', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e3f5e9-e17a-4a5d-aa2b-b15b6bc63eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af1843a-b687-4a79-9a41-9a2924d462f4]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-c28804c6-993a-46cb-a6b0-c3d715325675 req-106d27a7-da20-4011-9e2a-0eb89b2c924e tempest-DeleteServersTestJSON-1368681151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:21 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Volume volume-3580b73a-0676-4765-a5c0-dcb410c9b5c4 (3580b73a-0676-4765-a5c0-dcb410c9b5c4): created successfully Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e3f5e9-e17a-4a5d-aa2b-b15b6bc63eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Flow 'volume_create_manager' (d7f1e5dd-4400-4fde-b06a-5d8b101f4b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:21 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-19af4860-bda8-4240-b178-e766a8d872e9 tempest-VolumesTestJSON-1360783439 None] Created volume successfully. Feb 27 02:04:21 devstack sudo[84257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f Feb 27 02:04:21 devstack sudo[84257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ea6cc000-eadf-4715-b987-950127ebfa25 tempest-SnapshotsActionsTest-982775048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:21 devstack sudo[84257]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-c28804c6-993a-46cb-a6b0-c3d715325675 req-106d27a7-da20-4011-9e2a-0eb89b2c924e tempest-DeleteServersTestJSON-1368681151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f" returned: 0 in 0.622s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-c28804c6-993a-46cb-a6b0-c3d715325675 req-106d27a7-da20-4011-9e2a-0eb89b2c924e tempest-DeleteServersTestJSON-1368681151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.640s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.984s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] Creating offline snapshot 644f552c-a42a-4c0c-b3bb-278968bf2398 of volume 66e5114a-85de-4721-88dd-501d6ccf2a90 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-c28804c6-993a-46cb-a6b0-c3d715325675 req-106d27a7-da20-4011-9e2a-0eb89b2c924e tempest-DeleteServersTestJSON-1368681151 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf', 'name': 'volume-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ced99c99-0d2f-4cad-abb6-9ca320800e1d', 'enforce_multipath': True} {{(pid=82738) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2151088-b1e6-4870-ab84-37579f5b459f]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:22 devstack cinder-volume[82738]: INFO cinder.volume.manager [req-c28804c6-993a-46cb-a6b0-c3d715325675 req-106d27a7-da20-4011-9e2a-0eb89b2c924e tempest-DeleteServersTestJSON-1368681151 None] attachment_update completed successfully. Feb 27 02:04:22 devstack sudo[84262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90 Feb 27 02:04:22 devstack sudo[84262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:22 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:22 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Flow 'volume_create_manager' (05a1051e-39e5-4476-a2f5-785f87f1446d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:22 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9623896-4883-4b40-81de-7aa21662153e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:22 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9623896-4883-4b40-81de-7aa21662153e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-741130101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51508f4-de51-4045-bbd6-2d9b3733e137,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4def43ea77514869bb45913dc8f8c95e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:22Z,use_quota=True,user_id='fb61599c397641379525563882563fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:22 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184e0982-de0c-4a91-b5b3-cd3e3b04f1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:22 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184e0982-de0c-4a91-b5b3-cd3e3b04f1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:22 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6655206-1198-41e6-8299-e3341a850bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:22 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6655206-1198-41e6-8299-e3341a850bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a51508f4-de51-4045-bbd6-2d9b3733e137', 'volume_name': 'volume-a51508f4-de51-4045-bbd6-2d9b3733e137', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:22 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566e9d97-c8c9-4ac3-a5ff-9046d538a1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:22 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566e9d97-c8c9-4ac3-a5ff-9046d538a1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:22 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59ecceb-b948-4f66-8721-5a0881f48138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:22 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Volume a51508f4-de51-4045-bbd6-2d9b3733e137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a51508f4-de51-4045-bbd6-2d9b3733e137', 'volume_size': 1} Feb 27 02:04:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:22 devstack sudo[84262]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90" returned: 0 in 0.803s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.644f552c-a42a-4c0c-b3bb-278968bf2398 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:22 devstack sudo[84268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.644f552c-a42a-4c0c-b3bb-278968bf2398 1G Feb 27 02:04:22 devstack sudo[84268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:23 devstack sudo[84268]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.644f552c-a42a-4c0c-b3bb-278968bf2398 1G" returned: 0 in 0.611s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e5114a-85de-4721-88dd-501d6ccf2a90 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.644f552c-a42a-4c0c-b3bb-278968bf2398 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:23 devstack sudo[84340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e5114a-85de-4721-88dd-501d6ccf2a90 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.644f552c-a42a-4c0c-b3bb-278968bf2398 Feb 27 02:04:23 devstack sudo[84340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:23 devstack cinder-volume[82738]: DEBUG oslo_service.periodic_task [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82738) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:04:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:23 devstack sudo[84659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:04:23 devstack sudo[84659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:23 devstack sudo[84340]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e5114a-85de-4721-88dd-501d6ccf2a90 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.644f552c-a42a-4c0c-b3bb-278968bf2398" returned: 0 in 0.587s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:23 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.644f552c-a42a-4c0c-b3bb-278968bf2398 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:04:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.644f552c-a42a-4c0c-b3bb-278968bf2398 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:23 devstack sudo[84664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.644f552c-a42a-4c0c-b3bb-278968bf2398 Feb 27 02:04:23 devstack sudo[84664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:24 devstack sudo[84659]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.600s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:24 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:24 devstack sudo[84664]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.644f552c-a42a-4c0c-b3bb-278968bf2398" returned: 0 in 0.511s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:24 devstack sudo[84668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.info Feb 27 02:04:24 devstack sudo[84668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:25 devstack sudo[84668]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.info" returned: 0 in 0.569s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:25 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:04:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:25 devstack sudo[84671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.info Feb 27 02:04:25 devstack sudo[84671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:25 devstack sudo[84671]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.info" returned: 0 in 0.504s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.678s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ea6cc000-eadf-4715-b987-950127ebfa25 tempest-SnapshotsActionsTest-982775048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.777s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:25 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-ea6cc000-eadf-4715-b987-950127ebfa25 tempest-SnapshotsActionsTest-982775048 None] Creating offline snapshot beddc1bb-0788-4781-8df9-575732b4c16b of volume cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:04:25 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e45d408-2fdb-407f-b568-a94ec0232f63]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ea6cc000-eadf-4715-b987-950127ebfa25 tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:25 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-41e72a86-d827-42b3-95bf-033889871818 tempest-GroupSnapshotsTest-1373289962 None] group_snapshot db5bbfd5-5e37-4153-92dc-9098b64bbd4a: created successfully Feb 27 02:04:25 devstack sudo[84674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 Feb 27 02:04:25 devstack sudo[84674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:26 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] group_snapshot db5bbfd5-5e37-4153-92dc-9098b64bbd4a: deleting Feb 27 02:04:26 devstack sudo[84674]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] group_snapshot db5bbfd5-5e37-4153-92dc-9098b64bbd4a: deleting {{(pid=82738) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 02:04:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ea6cc000-eadf-4715-b987-950127ebfa25 tempest-SnapshotsActionsTest-982775048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2" returned: 0 in 0.657s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-ea6cc000-eadf-4715-b987-950127ebfa25 tempest-SnapshotsActionsTest-982775048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ea6cc000-eadf-4715-b987-950127ebfa25 tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.beddc1bb-0788-4781-8df9-575732b4c16b 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:26 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "cinder-quobyte-66e5114a-85de-4721-88dd-501d6ccf2a90" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:26 devstack sudo[84679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.beddc1bb-0788-4781-8df9-575732b4c16b 1G Feb 27 02:04:26 devstack sudo[84679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:26 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-66e5114a-85de-4721-88dd-501d6ccf2a90" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:26 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "cinder-quobyte-644f552c-a42a-4c0c-b3bb-278968bf2398" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:26 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-644f552c-a42a-4c0c-b3bb-278968bf2398" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] Deleting offline snapshot 644f552c-a42a-4c0c-b3bb-278968bf2398 of volume 66e5114a-85de-4721-88dd-501d6ccf2a90 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:04:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] snapshot_file for this snap is: volume-66e5114a-85de-4721-88dd-501d6ccf2a90.644f552c-a42a-4c0c-b3bb-278968bf2398 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:04:26 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eedbbf2-a18a-4066-8248-6a5e448be7b1]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.644f552c-a42a-4c0c-b3bb-278968bf2398 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:26 devstack sudo[84681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.644f552c-a42a-4c0c-b3bb-278968bf2398 Feb 27 02:04:26 devstack sudo[84681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:26 devstack sudo[84679]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ea6cc000-eadf-4715-b987-950127ebfa25 tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.beddc1bb-0788-4781-8df9-575732b4c16b 1G" returned: 0 in 0.647s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ea6cc000-eadf-4715-b987-950127ebfa25 tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.beddc1bb-0788-4781-8df9-575732b4c16b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:26 devstack sudo[84689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.beddc1bb-0788-4781-8df9-575732b4c16b Feb 27 02:04:26 devstack sudo[84689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:27 devstack sudo[84681]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.644f552c-a42a-4c0c-b3bb-278968bf2398" returned: 0 in 0.659s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:27 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66e5114a-85de-4721-88dd-501d6ccf2a90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:27 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11285ed-09bc-41de-973e-53173eb0b904]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:27 devstack sudo[84691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90 Feb 27 02:04:27 devstack sudo[84691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:27 devstack sudo[84689]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ea6cc000-eadf-4715-b987-950127ebfa25 tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.beddc1bb-0788-4781-8df9-575732b4c16b" returned: 0 in 0.570s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:27 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-ea6cc000-eadf-4715-b987-950127ebfa25 tempest-SnapshotsActionsTest-982775048 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.beddc1bb-0788-4781-8df9-575732b4c16b is being set with open permissions: ugo+rw Feb 27 02:04:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ea6cc000-eadf-4715-b987-950127ebfa25 tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.beddc1bb-0788-4781-8df9-575732b4c16b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:27 devstack sudo[84696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.beddc1bb-0788-4781-8df9-575732b4c16b Feb 27 02:04:27 devstack sudo[84696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:27 devstack sudo[84691]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90" returned: 0 in 0.615s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.644f552c-a42a-4c0c-b3bb-278968bf2398 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:27 devstack sudo[84701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.644f552c-a42a-4c0c-b3bb-278968bf2398 Feb 27 02:04:27 devstack sudo[84701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:28 devstack sudo[84696]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ea6cc000-eadf-4715-b987-950127ebfa25 tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.beddc1bb-0788-4781-8df9-575732b4c16b" returned: 0 in 0.565s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ea6cc000-eadf-4715-b987-950127ebfa25 tempest-SnapshotsActionsTest-982775048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.519s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.458s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:28 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-741130101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51508f4-de51-4045-bbd6-2d9b3733e137,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4def43ea77514869bb45913dc8f8c95e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:22Z,use_quota=True,user_id='fb61599c397641379525563882563fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:28 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Creating volume a51508f4-de51-4045-bbd6-2d9b3733e137 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:28 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:28 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:28 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:28 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:04:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a51508f4-de51-4045-bbd6-2d9b3733e137 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:28 devstack sudo[84707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a51508f4-de51-4045-bbd6-2d9b3733e137 1073741824 Feb 27 02:04:28 devstack sudo[84707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:28 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-ea6cc000-eadf-4715-b987-950127ebfa25 tempest-SnapshotsActionsTest-982775048 None] Create snapshot completed successfully Feb 27 02:04:28 devstack sudo[84701]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.644f552c-a42a-4c0c-b3bb-278968bf2398" returned: 0 in 0.594s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.644f552c-a42a-4c0c-b3bb-278968bf2398 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:28 devstack sudo[84717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.644f552c-a42a-4c0c-b3bb-278968bf2398 Feb 27 02:04:28 devstack sudo[84717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:28 devstack sudo[84707]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a51508f4-de51-4045-bbd6-2d9b3733e137 1073741824" returned: 0 in 0.815s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a51508f4-de51-4045-bbd6-2d9b3733e137 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:28 devstack sudo[84717]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90.644f552c-a42a-4c0c-b3bb-278968bf2398" returned: 0 in 0.687s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:29 devstack sudo[84741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a51508f4-de51-4045-bbd6-2d9b3733e137 Feb 27 02:04:29 devstack sudo[84741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-644f552c-a42a-4c0c-b3bb-278968bf2398" released by "_delete_snapshot" :: held 2.666s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-66e5114a-85de-4721-88dd-501d6ccf2a90" released by "delete_snapshot" :: held 2.689s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:29 devstack cinder-volume[82738]: WARNING cinder.quota [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-562809120 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-562809120, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:04:29 devstack cinder-volume[82738]: WARNING cinder.quota [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-562809120 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-562809120, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] Created reservations ['846eaa14-a6c6-467d-9ae6-599e5c0178e3', 'a5e96c5a-f92c-420a-94cd-36407953bdf6', '6409bd6c-d74d-4740-ada4-ff013943903d', '5a73ed6b-a18c-4fd9-a5d7-4b6ebe18174f'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:29 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-07ee69f9-1519-4f75-80fc-08f78bfa50e0 tempest-GroupSnapshotsTest-1373289962 None] group_snapshot db5bbfd5-5e37-4153-92dc-9098b64bbd4a: deleted successfully Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] Acquiring lock "cinder-beddc1bb-0788-4781-8df9-575732b4c16b-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-beddc1bb-0788-4781-8df9-575732b4c16b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] Acquiring lock "cinder-quobyte-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-quobyte-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] Acquiring lock "cinder-quobyte-beddc1bb-0788-4781-8df9-575732b4c16b" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-quobyte-beddc1bb-0788-4781-8df9-575732b4c16b" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] Deleting offline snapshot beddc1bb-0788-4781-8df9-575732b4c16b of volume cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] snapshot_file for this snap is: volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.beddc1bb-0788-4781-8df9-575732b4c16b {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc55880-5f16-4fce-a20d-cbcb9adfea55]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.beddc1bb-0788-4781-8df9-575732b4c16b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:29 devstack sudo[84768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.beddc1bb-0788-4781-8df9-575732b4c16b Feb 27 02:04:29 devstack sudo[84768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:29 devstack sudo[84741]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a51508f4-de51-4045-bbd6-2d9b3733e137" returned: 0 in 0.507s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59ecceb-b948-4f66-8721-5a0881f48138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a51508f4-de51-4045-bbd6-2d9b3733e137', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4caee0d3-9bef-4b34-b547-4eb862500f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:29 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Volume volume-a51508f4-de51-4045-bbd6-2d9b3733e137 (a51508f4-de51-4045-bbd6-2d9b3733e137): created successfully Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4caee0d3-9bef-4b34-b547-4eb862500f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Flow 'volume_create_manager' (05a1051e-39e5-4476-a2f5-785f87f1446d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:29 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-02b63f1d-23e9-4993-8f0c-9e611d213b57 tempest-VolumesTestJSON-1360783439 None] Created volume successfully. Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4377126f-6783-41dc-afa5-c919ec16713f tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "cinder-quobyte-66e5114a-85de-4721-88dd-501d6ccf2a90" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4377126f-6783-41dc-afa5-c919ec16713f tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-66e5114a-85de-4721-88dd-501d6ccf2a90" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e95359b-8714-497f-ace7-91e5f91dd2ae]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4377126f-6783-41dc-afa5-c919ec16713f tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:29 devstack sudo[84768]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.beddc1bb-0788-4781-8df9-575732b4c16b" returned: 0 in 0.578s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c61ad7-7a2e-4685-964d-a9109ee12e39]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:29 devstack sudo[84774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90 Feb 27 02:04:29 devstack sudo[84774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:30 devstack sudo[84776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 Feb 27 02:04:30 devstack sudo[84776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:30 devstack sudo[84774]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4377126f-6783-41dc-afa5-c919ec16713f tempest-GroupSnapshotsTest-1373289962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90" returned: 0 in 0.707s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4377126f-6783-41dc-afa5-c919ec16713f tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:30 devstack sudo[84783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90 Feb 27 02:04:30 devstack sudo[84783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:30 devstack sudo[84776]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2" returned: 0 in 0.832s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:30 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.beddc1bb-0788-4781-8df9-575732b4c16b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:30 devstack sudo[84788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.beddc1bb-0788-4781-8df9-575732b4c16b Feb 27 02:04:30 devstack sudo[84788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:30 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fac26d7e-4c19-477f-abd0-9620e0d432fd tempest-VolumesTestJSON-1360783439 None] Acquiring lock "cinder-a51508f4-de51-4045-bbd6-2d9b3733e137-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:30 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fac26d7e-4c19-477f-abd0-9620e0d432fd tempest-VolumesTestJSON-1360783439 None] Lock "cinder-a51508f4-de51-4045-bbd6-2d9b3733e137-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:30 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fac26d7e-4c19-477f-abd0-9620e0d432fd tempest-VolumesTestJSON-1360783439 None] Acquiring lock "cinder-quobyte-a51508f4-de51-4045-bbd6-2d9b3733e137" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:30 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fac26d7e-4c19-477f-abd0-9620e0d432fd tempest-VolumesTestJSON-1360783439 None] Lock "cinder-quobyte-a51508f4-de51-4045-bbd6-2d9b3733e137" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:30 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedf96cd-1a39-47ac-80bf-afecbf127be2]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fac26d7e-4c19-477f-abd0-9620e0d432fd tempest-VolumesTestJSON-1360783439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a51508f4-de51-4045-bbd6-2d9b3733e137 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:31 devstack sudo[84791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a51508f4-de51-4045-bbd6-2d9b3733e137 Feb 27 02:04:31 devstack sudo[84791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:31 devstack sudo[84783]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4377126f-6783-41dc-afa5-c919ec16713f tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66e5114a-85de-4721-88dd-501d6ccf2a90" returned: 0 in 0.552s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:31 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4377126f-6783-41dc-afa5-c919ec16713f tempest-GroupSnapshotsTest-1373289962 None] Lock "cinder-quobyte-66e5114a-85de-4721-88dd-501d6ccf2a90" released by "delete_volume" :: held 1.315s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:31 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-4377126f-6783-41dc-afa5-c919ec16713f tempest-GroupSnapshotsTest-1373289962 None] Created reservations ['9d8516ec-3b15-44a0-9d7d-7d58906dfe92'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:31 devstack cinder-volume[82738]: WARNING cinder.quota [None req-4377126f-6783-41dc-afa5-c919ec16713f tempest-GroupSnapshotsTest-1373289962 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-562809120 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-562809120, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:04:31 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-4377126f-6783-41dc-afa5-c919ec16713f tempest-GroupSnapshotsTest-1373289962 None] Created reservations ['106b3fd1-0643-4fb1-8774-039bd9fb21f4', '91bcf4b4-433d-4394-a302-93be396254d6', 'a3944f9b-6e21-498e-be35-e050b9db8a74', 'b644d395-27f4-481f-9ddd-076ce7bdf879'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:31 devstack cinder-volume[82738]: INFO cinder.volume.manager [req-47b8afcd-bba5-4c32-8e9e-f26a099e3199 req-457d1f79-d51e-45c0-8656-897c437838fe tempest-DeleteServersTestJSON-1368681151 None] Terminate volume connection completed successfully. Feb 27 02:04:31 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-47b8afcd-bba5-4c32-8e9e-f26a099e3199 req-457d1f79-d51e-45c0-8656-897c437838fe tempest-DeleteServersTestJSON-1368681151 None] Deleting attachment ced99c99-0d2f-4cad-abb6-9ca320800e1d. {{(pid=82738) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 02:04:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4377126f-6783-41dc-afa5-c919ec16713f tempest-GroupSnapshotsTest-1373289962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4377126f-6783-41dc-afa5-c919ec16713f tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:31 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-4377126f-6783-41dc-afa5-c919ec16713f tempest-GroupSnapshotsTest-1373289962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:31 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-4377126f-6783-41dc-afa5-c919ec16713f tempest-GroupSnapshotsTest-1373289962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4377126f-6783-41dc-afa5-c919ec16713f tempest-GroupSnapshotsTest-1373289962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4377126f-6783-41dc-afa5-c919ec16713f tempest-GroupSnapshotsTest-1373289962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:31 devstack sudo[84796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:04:31 devstack sudo[84796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:31 devstack sudo[84788]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.beddc1bb-0788-4781-8df9-575732b4c16b" returned: 0 in 0.725s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.beddc1bb-0788-4781-8df9-575732b4c16b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:31 devstack sudo[84798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.beddc1bb-0788-4781-8df9-575732b4c16b Feb 27 02:04:31 devstack sudo[84798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:31 devstack sudo[84791]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fac26d7e-4c19-477f-abd0-9620e0d432fd tempest-VolumesTestJSON-1360783439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a51508f4-de51-4045-bbd6-2d9b3733e137" returned: 0 in 0.669s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fac26d7e-4c19-477f-abd0-9620e0d432fd tempest-VolumesTestJSON-1360783439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a51508f4-de51-4045-bbd6-2d9b3733e137 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:31 devstack sudo[84803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a51508f4-de51-4045-bbd6-2d9b3733e137 Feb 27 02:04:31 devstack sudo[84803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:31 devstack sudo[84796]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4377126f-6783-41dc-afa5-c919ec16713f tempest-GroupSnapshotsTest-1373289962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.528s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:31 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-4377126f-6783-41dc-afa5-c919ec16713f tempest-GroupSnapshotsTest-1373289962 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:31 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-4377126f-6783-41dc-afa5-c919ec16713f tempest-GroupSnapshotsTest-1373289962 None] Delete group completed successfully. Feb 27 02:04:31 devstack sudo[84798]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.beddc1bb-0788-4781-8df9-575732b4c16b" returned: 0 in 0.484s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:31 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-quobyte-beddc1bb-0788-4781-8df9-575732b4c16b" released by "_delete_snapshot" :: held 2.738s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:31 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-quobyte-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" released by "delete_snapshot" :: held 2.755s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:32 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] Created reservations ['1f1342a6-58fe-439d-bccd-6073f1963dea', '09c176dc-94ff-4cba-afe9-cde70fc99219', '4fb286e0-a6df-4213-b364-78f418ec6980', '8ce22086-d78e-4aa3-b87e-bafaa86a9ef0'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:32 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] Delete snapshot completed successfully. Feb 27 02:04:32 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f5f93543-45c8-4d66-8946-a23de4879938 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-beddc1bb-0788-4781-8df9-575732b4c16b-delete_snapshot" released by "delete_snapshot" :: held 2.875s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:32 devstack sudo[84803]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fac26d7e-4c19-477f-abd0-9620e0d432fd tempest-VolumesTestJSON-1360783439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a51508f4-de51-4045-bbd6-2d9b3733e137" returned: 0 in 0.516s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:32 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fac26d7e-4c19-477f-abd0-9620e0d432fd tempest-VolumesTestJSON-1360783439 None] Lock "cinder-quobyte-a51508f4-de51-4045-bbd6-2d9b3733e137" released by "delete_volume" :: held 1.244s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:32 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-fac26d7e-4c19-477f-abd0-9620e0d432fd tempest-VolumesTestJSON-1360783439 None] Created reservations ['ecf2e609-522e-4b39-a011-8d972ae01dfd', '413279be-d4d1-4cae-a5a0-cbd23ef078f0', '38d61886-c391-45a9-8153-95ad09825602', 'c4077fd1-0ef6-41c6-8d00-91da2cc988b9'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fac26d7e-4c19-477f-abd0-9620e0d432fd tempest-VolumesTestJSON-1360783439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fac26d7e-4c19-477f-abd0-9620e0d432fd tempest-VolumesTestJSON-1360783439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:32 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-fac26d7e-4c19-477f-abd0-9620e0d432fd tempest-VolumesTestJSON-1360783439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:32 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-fac26d7e-4c19-477f-abd0-9620e0d432fd tempest-VolumesTestJSON-1360783439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fac26d7e-4c19-477f-abd0-9620e0d432fd tempest-VolumesTestJSON-1360783439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fac26d7e-4c19-477f-abd0-9620e0d432fd tempest-VolumesTestJSON-1360783439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:32 devstack sudo[84808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:04:32 devstack sudo[84808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0040a14f-27c3-4ec7-a158-efa69e8a466b tempest-SnapshotsActionsTest-982775048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0040a14f-27c3-4ec7-a158-efa69e8a466b tempest-SnapshotsActionsTest-982775048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:32 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-0040a14f-27c3-4ec7-a158-efa69e8a466b tempest-SnapshotsActionsTest-982775048 None] Creating offline snapshot 6dad5c69-e9a3-4529-8649-041b2b2366b7 of volume cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:04:32 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[c809605b-65ed-460c-adc2-7818fb6beaf7]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0040a14f-27c3-4ec7-a158-efa69e8a466b tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:32 devstack sudo[84810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 Feb 27 02:04:32 devstack sudo[84810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:32 devstack sudo[84808]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fac26d7e-4c19-477f-abd0-9620e0d432fd tempest-VolumesTestJSON-1360783439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.621s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:32 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-fac26d7e-4c19-477f-abd0-9620e0d432fd tempest-VolumesTestJSON-1360783439 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:32 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-fac26d7e-4c19-477f-abd0-9620e0d432fd tempest-VolumesTestJSON-1360783439 None] Deleted volume successfully. Feb 27 02:04:32 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fac26d7e-4c19-477f-abd0-9620e0d432fd tempest-VolumesTestJSON-1360783439 None] Lock "cinder-a51508f4-de51-4045-bbd6-2d9b3733e137-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:33 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d53c4de-0e51-49c1-82b6-685a49efea2a tempest-VolumesTestJSON-1360783439 None] Acquiring lock "cinder-3580b73a-0676-4765-a5c0-dcb410c9b5c4-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:33 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d53c4de-0e51-49c1-82b6-685a49efea2a tempest-VolumesTestJSON-1360783439 None] Lock "cinder-3580b73a-0676-4765-a5c0-dcb410c9b5c4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:33 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d53c4de-0e51-49c1-82b6-685a49efea2a tempest-VolumesTestJSON-1360783439 None] Acquiring lock "cinder-quobyte-3580b73a-0676-4765-a5c0-dcb410c9b5c4" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:33 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d53c4de-0e51-49c1-82b6-685a49efea2a tempest-VolumesTestJSON-1360783439 None] Lock "cinder-quobyte-3580b73a-0676-4765-a5c0-dcb410c9b5c4" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:33 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[119f723e-f3b2-4e82-b52c-4bfb6170b1bc]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8d53c4de-0e51-49c1-82b6-685a49efea2a tempest-VolumesTestJSON-1360783439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3580b73a-0676-4765-a5c0-dcb410c9b5c4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:33 devstack sudo[84813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3580b73a-0676-4765-a5c0-dcb410c9b5c4 Feb 27 02:04:33 devstack sudo[84813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:33 devstack sudo[84810]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0040a14f-27c3-4ec7-a158-efa69e8a466b tempest-SnapshotsActionsTest-982775048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2" returned: 0 in 0.662s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-0040a14f-27c3-4ec7-a158-efa69e8a466b tempest-SnapshotsActionsTest-982775048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0040a14f-27c3-4ec7-a158-efa69e8a466b tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.6dad5c69-e9a3-4529-8649-041b2b2366b7 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:33 devstack sudo[84818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.6dad5c69-e9a3-4529-8649-041b2b2366b7 1G Feb 27 02:04:33 devstack sudo[84818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:33 devstack sudo[84813]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8d53c4de-0e51-49c1-82b6-685a49efea2a tempest-VolumesTestJSON-1360783439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3580b73a-0676-4765-a5c0-dcb410c9b5c4" returned: 0 in 0.701s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8d53c4de-0e51-49c1-82b6-685a49efea2a tempest-VolumesTestJSON-1360783439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3580b73a-0676-4765-a5c0-dcb410c9b5c4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:33 devstack sudo[84825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3580b73a-0676-4765-a5c0-dcb410c9b5c4 Feb 27 02:04:33 devstack sudo[84825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:34 devstack sudo[84818]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0040a14f-27c3-4ec7-a158-efa69e8a466b tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.6dad5c69-e9a3-4529-8649-041b2b2366b7 1G" returned: 0 in 0.682s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0040a14f-27c3-4ec7-a158-efa69e8a466b tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.6dad5c69-e9a3-4529-8649-041b2b2366b7 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:34 devstack sudo[84828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.6dad5c69-e9a3-4529-8649-041b2b2366b7 Feb 27 02:04:34 devstack sudo[84828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:34 devstack sudo[84825]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8d53c4de-0e51-49c1-82b6-685a49efea2a tempest-VolumesTestJSON-1360783439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3580b73a-0676-4765-a5c0-dcb410c9b5c4" returned: 0 in 0.581s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:34 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d53c4de-0e51-49c1-82b6-685a49efea2a tempest-VolumesTestJSON-1360783439 None] Lock "cinder-quobyte-3580b73a-0676-4765-a5c0-dcb410c9b5c4" released by "delete_volume" :: held 1.320s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:34 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-8d53c4de-0e51-49c1-82b6-685a49efea2a tempest-VolumesTestJSON-1360783439 None] Created reservations ['abfe4c00-c485-4978-a222-641be6b9f054', 'a5eb83c0-d224-4a14-9fbe-ee861ed5ac39', '8ea1e45b-47f6-476a-84ed-5bb60062b1ce', 'cc64c42c-15d8-4245-bab2-51c80b648601'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8d53c4de-0e51-49c1-82b6-685a49efea2a tempest-VolumesTestJSON-1360783439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8d53c4de-0e51-49c1-82b6-685a49efea2a tempest-VolumesTestJSON-1360783439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:34 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8d53c4de-0e51-49c1-82b6-685a49efea2a tempest-VolumesTestJSON-1360783439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:34 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8d53c4de-0e51-49c1-82b6-685a49efea2a tempest-VolumesTestJSON-1360783439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8d53c4de-0e51-49c1-82b6-685a49efea2a tempest-VolumesTestJSON-1360783439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8d53c4de-0e51-49c1-82b6-685a49efea2a tempest-VolumesTestJSON-1360783439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:34 devstack sudo[84833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:04:34 devstack sudo[84833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:34 devstack sudo[84828]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0040a14f-27c3-4ec7-a158-efa69e8a466b tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.6dad5c69-e9a3-4529-8649-041b2b2366b7" returned: 0 in 0.675s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:34 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-0040a14f-27c3-4ec7-a158-efa69e8a466b tempest-SnapshotsActionsTest-982775048 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.6dad5c69-e9a3-4529-8649-041b2b2366b7 is being set with open permissions: ugo+rw Feb 27 02:04:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0040a14f-27c3-4ec7-a158-efa69e8a466b tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.6dad5c69-e9a3-4529-8649-041b2b2366b7 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:34 devstack sudo[84836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.6dad5c69-e9a3-4529-8649-041b2b2366b7 Feb 27 02:04:34 devstack sudo[84836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:34 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ed37fec2-37f9-434e-9db7-8d2f3b9c8ad3 tempest-DeleteServersTestJSON-1368681151 None] Acquiring lock "cinder-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:34 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ed37fec2-37f9-434e-9db7-8d2f3b9c8ad3 tempest-DeleteServersTestJSON-1368681151 None] Lock "cinder-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:34 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ed37fec2-37f9-434e-9db7-8d2f3b9c8ad3 tempest-DeleteServersTestJSON-1368681151 None] Acquiring lock "cinder-quobyte-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:34 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ed37fec2-37f9-434e-9db7-8d2f3b9c8ad3 tempest-DeleteServersTestJSON-1368681151 None] Lock "cinder-quobyte-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f" acquired by "delete_volume" :: waited 0.017s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:34 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[903a3332-13cc-4f7a-aab8-c7d3b32f5d44]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ed37fec2-37f9-434e-9db7-8d2f3b9c8ad3 tempest-DeleteServersTestJSON-1368681151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:35 devstack sudo[84833]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8d53c4de-0e51-49c1-82b6-685a49efea2a tempest-VolumesTestJSON-1360783439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.532s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:35 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-8d53c4de-0e51-49c1-82b6-685a49efea2a tempest-VolumesTestJSON-1360783439 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:35 devstack sudo[84839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f Feb 27 02:04:35 devstack sudo[84839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:35 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-8d53c4de-0e51-49c1-82b6-685a49efea2a tempest-VolumesTestJSON-1360783439 None] Deleted volume successfully. Feb 27 02:04:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d53c4de-0e51-49c1-82b6-685a49efea2a tempest-VolumesTestJSON-1360783439 None] Lock "cinder-3580b73a-0676-4765-a5c0-dcb410c9b5c4-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-223e7fa3-d807-43d5-9610-45fccf53ef19 tempest-VolumesTestJSON-1360783439 None] Acquiring lock "cinder-e79cdd23-db7d-4c29-b94f-af339d828361-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-223e7fa3-d807-43d5-9610-45fccf53ef19 tempest-VolumesTestJSON-1360783439 None] Lock "cinder-e79cdd23-db7d-4c29-b94f-af339d828361-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:35 devstack sudo[84836]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0040a14f-27c3-4ec7-a158-efa69e8a466b tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.6dad5c69-e9a3-4529-8649-041b2b2366b7" returned: 0 in 0.692s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0040a14f-27c3-4ec7-a158-efa69e8a466b tempest-SnapshotsActionsTest-982775048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.777s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-223e7fa3-d807-43d5-9610-45fccf53ef19 tempest-VolumesTestJSON-1360783439 None] Acquiring lock "cinder-quobyte-e79cdd23-db7d-4c29-b94f-af339d828361" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-223e7fa3-d807-43d5-9610-45fccf53ef19 tempest-VolumesTestJSON-1360783439 None] Lock "cinder-quobyte-e79cdd23-db7d-4c29-b94f-af339d828361" acquired by "delete_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:35 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-0040a14f-27c3-4ec7-a158-efa69e8a466b tempest-SnapshotsActionsTest-982775048 None] Create snapshot completed successfully Feb 27 02:04:35 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f4adb5-1ef6-4c68-ba1b-7aeb41818ade]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-223e7fa3-d807-43d5-9610-45fccf53ef19 tempest-VolumesTestJSON-1360783439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e79cdd23-db7d-4c29-b94f-af339d828361 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:35 devstack sudo[84843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e79cdd23-db7d-4c29-b94f-af339d828361 Feb 27 02:04:35 devstack sudo[84843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:35 devstack sudo[84839]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ed37fec2-37f9-434e-9db7-8d2f3b9c8ad3 tempest-DeleteServersTestJSON-1368681151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f" returned: 0 in 0.679s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ed37fec2-37f9-434e-9db7-8d2f3b9c8ad3 tempest-DeleteServersTestJSON-1368681151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:35 devstack sudo[84847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f Feb 27 02:04:35 devstack sudo[84847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] Acquiring lock "cinder-6dad5c69-e9a3-4529-8649-041b2b2366b7-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-6dad5c69-e9a3-4529-8649-041b2b2366b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] Acquiring lock "cinder-quobyte-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-quobyte-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] Acquiring lock "cinder-quobyte-6dad5c69-e9a3-4529-8649-041b2b2366b7" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-quobyte-6dad5c69-e9a3-4529-8649-041b2b2366b7" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] Deleting offline snapshot 6dad5c69-e9a3-4529-8649-041b2b2366b7 of volume cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] snapshot_file for this snap is: volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.6dad5c69-e9a3-4529-8649-041b2b2366b7 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4c2f1a-ae78-472c-86be-929d1ee70c11]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.6dad5c69-e9a3-4529-8649-041b2b2366b7 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:36 devstack sudo[84850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.6dad5c69-e9a3-4529-8649-041b2b2366b7 Feb 27 02:04:36 devstack sudo[84850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:36 devstack sudo[84843]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-223e7fa3-d807-43d5-9610-45fccf53ef19 tempest-VolumesTestJSON-1360783439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e79cdd23-db7d-4c29-b94f-af339d828361" returned: 0 in 0.701s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-223e7fa3-d807-43d5-9610-45fccf53ef19 tempest-VolumesTestJSON-1360783439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e79cdd23-db7d-4c29-b94f-af339d828361 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:36 devstack sudo[84847]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ed37fec2-37f9-434e-9db7-8d2f3b9c8ad3 tempest-DeleteServersTestJSON-1368681151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f" returned: 0 in 0.550s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ed37fec2-37f9-434e-9db7-8d2f3b9c8ad3 tempest-DeleteServersTestJSON-1368681151 None] Lock "cinder-quobyte-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f" released by "delete_volume" :: held 1.267s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:36 devstack sudo[84855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e79cdd23-db7d-4c29-b94f-af339d828361 Feb 27 02:04:36 devstack sudo[84855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-ed37fec2-37f9-434e-9db7-8d2f3b9c8ad3 tempest-DeleteServersTestJSON-1368681151 None] Created reservations ['8d28d20f-9623-4679-97df-7fa16190f4cf', '9aeac23b-7887-4c2e-8011-279331864a6f', 'c2d813d4-2a06-4a02-86ec-cd1426afed37', '47c03855-0515-479f-b69a-766773b4c5a3'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ed37fec2-37f9-434e-9db7-8d2f3b9c8ad3 tempest-DeleteServersTestJSON-1368681151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ed37fec2-37f9-434e-9db7-8d2f3b9c8ad3 tempest-DeleteServersTestJSON-1368681151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ed37fec2-37f9-434e-9db7-8d2f3b9c8ad3 tempest-DeleteServersTestJSON-1368681151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ed37fec2-37f9-434e-9db7-8d2f3b9c8ad3 tempest-DeleteServersTestJSON-1368681151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ed37fec2-37f9-434e-9db7-8d2f3b9c8ad3 tempest-DeleteServersTestJSON-1368681151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ed37fec2-37f9-434e-9db7-8d2f3b9c8ad3 tempest-DeleteServersTestJSON-1368681151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:36 devstack sudo[84857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:04:36 devstack sudo[84857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:36 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-4ead5843-41f9-41b0-9aab-928f1cb1f45d tempest-GroupSnapshotsV319Test-633353559 None] Group tempest-GroupSnapshotsV319Test-Group-1230098116: creating Feb 27 02:04:36 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-4ead5843-41f9-41b0-9aab-928f1cb1f45d tempest-GroupSnapshotsV319Test-633353559 None] Group tempest-GroupSnapshotsV319Test-Group-1230098116: created successfully Feb 27 02:04:36 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-4ead5843-41f9-41b0-9aab-928f1cb1f45d tempest-GroupSnapshotsV319Test-633353559 None] Create group completed successfully. Feb 27 02:04:36 devstack sudo[84850]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.6dad5c69-e9a3-4529-8649-041b2b2366b7" returned: 0 in 0.697s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[12443845-3cd2-480b-a619-f52f51037566]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:36 devstack sudo[84863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 Feb 27 02:04:36 devstack sudo[84863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:36 devstack sudo[84855]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-223e7fa3-d807-43d5-9610-45fccf53ef19 tempest-VolumesTestJSON-1360783439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e79cdd23-db7d-4c29-b94f-af339d828361" returned: 0 in 0.619s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-223e7fa3-d807-43d5-9610-45fccf53ef19 tempest-VolumesTestJSON-1360783439 None] Lock "cinder-quobyte-e79cdd23-db7d-4c29-b94f-af339d828361" released by "delete_volume" :: held 1.354s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-223e7fa3-d807-43d5-9610-45fccf53ef19 tempest-VolumesTestJSON-1360783439 None] Created reservations ['a30c4fc4-2d2c-4f27-8913-0b486cf7425b', '1ae73348-5dca-4f54-bd14-dab42bd51bcd', 'c06fdb18-39fe-43e0-952a-d993d2f5807c', 'eda1f4d0-de3a-41be-b580-e66342f5e3ac'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:36 devstack sudo[84857]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ed37fec2-37f9-434e-9db7-8d2f3b9c8ad3 tempest-DeleteServersTestJSON-1368681151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.565s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-ed37fec2-37f9-434e-9db7-8d2f3b9c8ad3 tempest-DeleteServersTestJSON-1368681151 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-223e7fa3-d807-43d5-9610-45fccf53ef19 tempest-VolumesTestJSON-1360783439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-223e7fa3-d807-43d5-9610-45fccf53ef19 tempest-VolumesTestJSON-1360783439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-223e7fa3-d807-43d5-9610-45fccf53ef19 tempest-VolumesTestJSON-1360783439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-223e7fa3-d807-43d5-9610-45fccf53ef19 tempest-VolumesTestJSON-1360783439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-223e7fa3-d807-43d5-9610-45fccf53ef19 tempest-VolumesTestJSON-1360783439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-223e7fa3-d807-43d5-9610-45fccf53ef19 tempest-VolumesTestJSON-1360783439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:36 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-ed37fec2-37f9-434e-9db7-8d2f3b9c8ad3 tempest-DeleteServersTestJSON-1368681151 None] Deleted volume successfully. Feb 27 02:04:36 devstack sudo[84866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:04:36 devstack sudo[84866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:36 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ed37fec2-37f9-434e-9db7-8d2f3b9c8ad3 tempest-DeleteServersTestJSON-1368681151 None] Lock "cinder-c5f8389a-fa72-402f-b2cd-5c986e2b8f1f-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:37 devstack sudo[84863]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2" returned: 0 in 0.629s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:37 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.6dad5c69-e9a3-4529-8649-041b2b2366b7 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:37 devstack sudo[84872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.6dad5c69-e9a3-4529-8649-041b2b2366b7 Feb 27 02:04:37 devstack sudo[84872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:37 devstack sudo[84866]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-223e7fa3-d807-43d5-9610-45fccf53ef19 tempest-VolumesTestJSON-1360783439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.538s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:37 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-223e7fa3-d807-43d5-9610-45fccf53ef19 tempest-VolumesTestJSON-1360783439 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:37 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-223e7fa3-d807-43d5-9610-45fccf53ef19 tempest-VolumesTestJSON-1360783439 None] Deleted volume successfully. Feb 27 02:04:37 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-223e7fa3-d807-43d5-9610-45fccf53ef19 tempest-VolumesTestJSON-1360783439 None] Lock "cinder-e79cdd23-db7d-4c29-b94f-af339d828361-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:38 devstack sudo[84872]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.6dad5c69-e9a3-4529-8649-041b2b2366b7" returned: 0 in 0.716s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.6dad5c69-e9a3-4529-8649-041b2b2366b7 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:38 devstack sudo[84877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.6dad5c69-e9a3-4529-8649-041b2b2366b7 Feb 27 02:04:38 devstack sudo[84877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Flow 'volume_create_manager' (bc185dd1-6f7e-436d-99b6-89524ce3a626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e53ee62-009a-46a6-8453-1a41751f0f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e53ee62-009a-46a6-8453-1a41751f0f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1965080353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e8042256-8e65-4de8-bc0c-b20d53bdeed6,host='devstack@QuobyteHD#QuobyteHD',id=f4736348-bbb6-46b9-8a9e-63cff20a0ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361c3acc7b1b47dd852f427d8bb9b84b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:38Z,use_quota=True,user_id='3d6b23c94d2b404788a5f38002e4a198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a793526f-d680-42f1-8498-209326af2667),volume_type_id=a793526f-d680-42f1-8498-209326af2667)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5cefed5-c6f8-4d5c-b890-c60b3ca78a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5cefed5-c6f8-4d5c-b890-c60b3ca78a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e268d24-3e3e-4a14-a184-ee5642a7ad3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e268d24-3e3e-4a14-a184-ee5642a7ad3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4736348-bbb6-46b9-8a9e-63cff20a0ce6', 'volume_name': 'volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43576ed7-da8e-423d-85e8-3c0f387bf159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43576ed7-da8e-423d-85e8-3c0f387bf159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7305192-c0f2-4dfb-ba19-b7539a09c6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:38 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Volume f4736348-bbb6-46b9-8a9e-63cff20a0ce6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6', 'volume_size': 1} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e8042256-8e65-4de8-bc0c-b20d53bdeed6,created_at=2026-02-27T01:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1965080353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e8042256-8e65-4de8-bc0c-b20d53bdeed6,host='devstack@QuobyteHD#QuobyteHD',id=f4736348-bbb6-46b9-8a9e-63cff20a0ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361c3acc7b1b47dd852f427d8bb9b84b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:38Z,use_quota=True,user_id='3d6b23c94d2b404788a5f38002e4a198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a793526f-d680-42f1-8498-209326af2667),volume_type_id=a793526f-d680-42f1-8498-209326af2667)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Creating volume f4736348-bbb6-46b9-8a9e-63cff20a0ce6 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:38 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:38 devstack sudo[84879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6 1073741824 Feb 27 02:04:38 devstack sudo[84879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:38 devstack sudo[84877]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.6dad5c69-e9a3-4529-8649-041b2b2366b7" returned: 0 in 0.618s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-quobyte-6dad5c69-e9a3-4529-8649-041b2b2366b7" released by "_delete_snapshot" :: held 2.731s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-quobyte-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" released by "delete_snapshot" :: held 2.750s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] Created reservations ['130e2313-39ea-468d-b687-bc5f758a41aa', '59481729-b97b-4831-8f5b-9fe637874047', 'baef8c18-8bce-47fb-bca4-2d14f0be55d1', 'f3e10f3c-bf37-40dd-89e7-b548a84c6fe2'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:38 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] Delete snapshot completed successfully. Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-80f6a2c8-60ab-4ffb-80b0-43c82d572d88 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-6dad5c69-e9a3-4529-8649-041b2b2366b7-delete_snapshot" released by "delete_snapshot" :: held 2.901s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:38 devstack sudo[84879]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6 1073741824" returned: 0 in 0.740s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:39 devstack sudo[84886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6 Feb 27 02:04:39 devstack sudo[84886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9827f29f-a9ad-4f30-9a7f-0b2c9e4cf779 tempest-SnapshotsActionsTest-982775048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:39 devstack sudo[84886]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6" returned: 0 in 0.614s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:39 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9827f29f-a9ad-4f30-9a7f-0b2c9e4cf779 tempest-SnapshotsActionsTest-982775048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.174s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:39 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7305192-c0f2-4dfb-ba19-b7539a09c6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:39 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6deed3f0-6337-49b2-9942-06655efa4aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:39 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-9827f29f-a9ad-4f30-9a7f-0b2c9e4cf779 tempest-SnapshotsActionsTest-982775048 None] Creating offline snapshot 1482585f-7379-4473-8cbc-7ec078b9dbb5 of volume cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:04:39 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Volume volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6 (f4736348-bbb6-46b9-8a9e-63cff20a0ce6): created successfully Feb 27 02:04:39 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6deed3f0-6337-49b2-9942-06655efa4aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:39 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Flow 'volume_create_manager' (bc185dd1-6f7e-436d-99b6-89524ce3a626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:39 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b1222d-5dab-4133-a5ed-1abf6041d9d0]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9827f29f-a9ad-4f30-9a7f-0b2c9e4cf779 tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:39 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-d29b9d23-deba-4398-88a4-a02a795c8c16 tempest-GroupSnapshotsV319Test-633353559 None] Created volume successfully. Feb 27 02:04:39 devstack sudo[84889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 Feb 27 02:04:39 devstack sudo[84889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:40 devstack sudo[84889]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9827f29f-a9ad-4f30-9a7f-0b2c9e4cf779 tempest-SnapshotsActionsTest-982775048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2" returned: 0 in 0.578s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:40 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-9827f29f-a9ad-4f30-9a7f-0b2c9e4cf779 tempest-SnapshotsActionsTest-982775048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9827f29f-a9ad-4f30-9a7f-0b2c9e4cf779 tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.1482585f-7379-4473-8cbc-7ec078b9dbb5 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:40 devstack sudo[84894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.1482585f-7379-4473-8cbc-7ec078b9dbb5 1G Feb 27 02:04:40 devstack sudo[84894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:40 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] GroupSnapshot a0714439-b602-4583-86d7-ffb85d92e84b: creating. Feb 27 02:04:40 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] Group snapshot a0714439-b602-4583-86d7-ffb85d92e84b: creating. {{(pid=82738) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 02:04:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:41 devstack sudo[84894]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9827f29f-a9ad-4f30-9a7f-0b2c9e4cf779 tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.1482585f-7379-4473-8cbc-7ec078b9dbb5 1G" returned: 0 in 0.735s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9827f29f-a9ad-4f30-9a7f-0b2c9e4cf779 tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.1482585f-7379-4473-8cbc-7ec078b9dbb5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:41 devstack sudo[84900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.1482585f-7379-4473-8cbc-7ec078b9dbb5 Feb 27 02:04:41 devstack sudo[84900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:41 devstack sudo[84900]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9827f29f-a9ad-4f30-9a7f-0b2c9e4cf779 tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.1482585f-7379-4473-8cbc-7ec078b9dbb5" returned: 0 in 0.546s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:41 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-9827f29f-a9ad-4f30-9a7f-0b2c9e4cf779 tempest-SnapshotsActionsTest-982775048 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.1482585f-7379-4473-8cbc-7ec078b9dbb5 is being set with open permissions: ugo+rw Feb 27 02:04:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9827f29f-a9ad-4f30-9a7f-0b2c9e4cf779 tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.1482585f-7379-4473-8cbc-7ec078b9dbb5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:41 devstack sudo[84906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.1482585f-7379-4473-8cbc-7ec078b9dbb5 Feb 27 02:04:41 devstack sudo[84906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0aa68242-059c-41f0-837c-c74d8236d1fd tempest-BackendsCapabilitiesAdminTestsJSON-1551092368 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82738) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 27 02:04:42 devstack sudo[84906]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9827f29f-a9ad-4f30-9a7f-0b2c9e4cf779 tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.1482585f-7379-4473-8cbc-7ec078b9dbb5" returned: 0 in 0.546s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9827f29f-a9ad-4f30-9a7f-0b2c9e4cf779 tempest-SnapshotsActionsTest-982775048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.513s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.486s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:42 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] Creating offline snapshot 7b4e3bcf-bc14-4cd1-90ab-3d2594aae646 of volume f4736348-bbb6-46b9-8a9e-63cff20a0ce6 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:04:42 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60aeaef-31f5-4586-a349-c42688e0c39b]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:42 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-9827f29f-a9ad-4f30-9a7f-0b2c9e4cf779 tempest-SnapshotsActionsTest-982775048 None] Create snapshot completed successfully Feb 27 02:04:42 devstack sudo[84909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6 Feb 27 02:04:42 devstack sudo[84909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:42 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1b925814-8c0f-4cec-8ec2-ca33bc4ffb99 tempest-BackendsCapabilitiesAdminTestsJSON-1551092368 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82738) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 27 02:04:42 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] Acquiring lock "cinder-1482585f-7379-4473-8cbc-7ec078b9dbb5-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:42 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-1482585f-7379-4473-8cbc-7ec078b9dbb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:42 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] Acquiring lock "cinder-quobyte-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:42 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-quobyte-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:42 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] Acquiring lock "cinder-quobyte-1482585f-7379-4473-8cbc-7ec078b9dbb5" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:42 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-quobyte-1482585f-7379-4473-8cbc-7ec078b9dbb5" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:42 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] Deleting offline snapshot 1482585f-7379-4473-8cbc-7ec078b9dbb5 of volume cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:04:42 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] snapshot_file for this snap is: volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.1482585f-7379-4473-8cbc-7ec078b9dbb5 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:04:42 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b0a3e2-34c5-481b-9bd1-7133aa44f230]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.1482585f-7379-4473-8cbc-7ec078b9dbb5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:42 devstack sudo[84909]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6" returned: 0 in 0.666s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.7b4e3bcf-bc14-4cd1-90ab-3d2594aae646 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:42 devstack sudo[84915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.7b4e3bcf-bc14-4cd1-90ab-3d2594aae646 1G Feb 27 02:04:42 devstack sudo[84915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:42 devstack sudo[84914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.1482585f-7379-4473-8cbc-7ec078b9dbb5 Feb 27 02:04:42 devstack sudo[84914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:43 devstack sudo[84915]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.7b4e3bcf-bc14-4cd1-90ab-3d2594aae646 1G" returned: 0 in 0.718s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.7b4e3bcf-bc14-4cd1-90ab-3d2594aae646 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:43 devstack sudo[84924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.7b4e3bcf-bc14-4cd1-90ab-3d2594aae646 Feb 27 02:04:43 devstack sudo[84924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:43 devstack sudo[84914]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.1482585f-7379-4473-8cbc-7ec078b9dbb5" returned: 0 in 0.773s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:43 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:43 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10979f4-2ec3-41b7-8075-58bff993bda4]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:43 devstack sudo[84926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 Feb 27 02:04:43 devstack sudo[84926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:44 devstack sudo[84924]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.7b4e3bcf-bc14-4cd1-90ab-3d2594aae646" returned: 0 in 0.598s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:44 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.7b4e3bcf-bc14-4cd1-90ab-3d2594aae646 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:04:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.7b4e3bcf-bc14-4cd1-90ab-3d2594aae646 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:44 devstack sudo[84931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.7b4e3bcf-bc14-4cd1-90ab-3d2594aae646 Feb 27 02:04:44 devstack sudo[84931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:44 devstack sudo[84926]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2" returned: 0 in 0.717s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:44 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.1482585f-7379-4473-8cbc-7ec078b9dbb5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:44 devstack sudo[84936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.1482585f-7379-4473-8cbc-7ec078b9dbb5 Feb 27 02:04:44 devstack sudo[84936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:44 devstack sudo[84931]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.7b4e3bcf-bc14-4cd1-90ab-3d2594aae646" returned: 0 in 0.561s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:44 devstack sudo[84939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.info Feb 27 02:04:44 devstack sudo[84939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:45 devstack sudo[84936]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.1482585f-7379-4473-8cbc-7ec078b9dbb5" returned: 0 in 0.731s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.1482585f-7379-4473-8cbc-7ec078b9dbb5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:45 devstack sudo[84944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.1482585f-7379-4473-8cbc-7ec078b9dbb5 Feb 27 02:04:45 devstack sudo[84944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:45 devstack sudo[84939]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.info" returned: 0 in 0.610s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:45 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:04:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:45 devstack sudo[84947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.info Feb 27 02:04:45 devstack sudo[84947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:45 devstack sudo[84944]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.1482585f-7379-4473-8cbc-7ec078b9dbb5" returned: 0 in 0.611s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-quobyte-1482585f-7379-4473-8cbc-7ec078b9dbb5" released by "_delete_snapshot" :: held 2.930s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-quobyte-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" released by "delete_snapshot" :: held 2.945s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:45 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] Created reservations ['81e17ec7-ae26-429c-8499-75d533ce66ed', '59757fbc-3b6f-4bc1-b7b4-eb5abc8629a3', '4ef44dcd-e3a0-438e-bbff-9047112c78d8', 'c5c1243d-58e4-40a1-9e7c-b89231eef679'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:45 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] Delete snapshot completed successfully. Feb 27 02:04:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a7a86e8d-0a06-42b6-b8bc-fc45f500df07 tempest-SnapshotsActionsTest-827658081 None] Lock "cinder-1482585f-7379-4473-8cbc-7ec078b9dbb5-delete_snapshot" released by "delete_snapshot" :: held 3.081s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:46 devstack sudo[84947]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.info" returned: 0 in 0.642s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.890s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:46 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-a64efa72-d0f4-48a6-b90d-87ad1677eae7 tempest-GroupSnapshotsV319Test-633353559 None] group_snapshot a0714439-b602-4583-86d7-ffb85d92e84b: created successfully Feb 27 02:04:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] Acquiring lock "cinder-ff87a37e-3687-4528-baaf-92b0f77e10d2-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] Lock "cinder-ff87a37e-3687-4528-baaf-92b0f77e10d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] Acquiring lock "cinder-quobyte-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] Lock "cinder-quobyte-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] Acquiring lock "cinder-quobyte-ff87a37e-3687-4528-baaf-92b0f77e10d2" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] Lock "cinder-quobyte-ff87a37e-3687-4528-baaf-92b0f77e10d2" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] Deleting offline snapshot ff87a37e-3687-4528-baaf-92b0f77e10d2 of volume cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:04:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] snapshot_file for this snap is: volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:04:46 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b156c6a-8c30-4ff3-b669-c9d2eaab54ac]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:46 devstack sudo[84951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 Feb 27 02:04:46 devstack sudo[84951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:47 devstack sudo[84951]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2" returned: 0 in 0.703s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:47 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef6ccf0-4588-4642-84d1-c308f34f17c3]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:47 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] group_snapshot a0714439-b602-4583-86d7-ffb85d92e84b: deleting Feb 27 02:04:47 devstack sudo[84956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c Feb 27 02:04:47 devstack sudo[84956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] group_snapshot a0714439-b602-4583-86d7-ffb85d92e84b: deleting {{(pid=82738) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 02:04:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] Acquiring lock "cinder-quobyte-f4736348-bbb6-46b9-8a9e-63cff20a0ce6" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] Lock "cinder-quobyte-f4736348-bbb6-46b9-8a9e-63cff20a0ce6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] Acquiring lock "cinder-quobyte-7b4e3bcf-bc14-4cd1-90ab-3d2594aae646" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] Lock "cinder-quobyte-7b4e3bcf-bc14-4cd1-90ab-3d2594aae646" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] Deleting offline snapshot 7b4e3bcf-bc14-4cd1-90ab-3d2594aae646 of volume f4736348-bbb6-46b9-8a9e-63cff20a0ce6 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:04:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] snapshot_file for this snap is: volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.7b4e3bcf-bc14-4cd1-90ab-3d2594aae646 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:04:47 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01efd6e-a225-4e62-9675-c30ccba2b73a]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.7b4e3bcf-bc14-4cd1-90ab-3d2594aae646 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:47 devstack sudo[84958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.7b4e3bcf-bc14-4cd1-90ab-3d2594aae646 Feb 27 02:04:47 devstack sudo[84958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:47 devstack sudo[84956]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" returned: 0 in 0.762s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:47 devstack sudo[84963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 Feb 27 02:04:47 devstack sudo[84963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:48 devstack sudo[84958]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.7b4e3bcf-bc14-4cd1-90ab-3d2594aae646" returned: 0 in 0.742s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:48 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:48 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd921ac-a787-450e-a301-5686cc1ac587]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:48 devstack sudo[84968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6 Feb 27 02:04:48 devstack sudo[84968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:48 devstack sudo[84963]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2" returned: 0 in 0.714s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:48 devstack sudo[84973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2 Feb 27 02:04:48 devstack sudo[84973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:48 devstack sudo[84968]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6" returned: 0 in 0.690s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.7b4e3bcf-bc14-4cd1-90ab-3d2594aae646 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:48 devstack sudo[84978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.7b4e3bcf-bc14-4cd1-90ab-3d2594aae646 Feb 27 02:04:48 devstack sudo[84978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:49 devstack sudo[84973]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c.ff87a37e-3687-4528-baaf-92b0f77e10d2" returned: 0 in 0.573s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] Lock "cinder-quobyte-ff87a37e-3687-4528-baaf-92b0f77e10d2" released by "_delete_snapshot" :: held 2.847s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] Lock "cinder-quobyte-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" released by "delete_snapshot" :: held 2.863s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:49 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] Created reservations ['f7b5067b-144e-4df0-900f-f39798f8d4b0', '40826dcf-69aa-4ce5-bdac-57d477e9be7f', '659f549e-156b-42ec-beaf-630ed1c314ac', '44cbb5e2-ea97-4ad7-a7f4-9097b67f80bd'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:49 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] Delete snapshot completed successfully. Feb 27 02:04:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-10cac88c-7986-4c8f-87b3-162244d0ad21 tempest-SnapshotsActionsTest-982775048 None] Lock "cinder-ff87a37e-3687-4528-baaf-92b0f77e10d2-delete_snapshot" released by "delete_snapshot" :: held 2.998s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:49 devstack sudo[84978]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.7b4e3bcf-bc14-4cd1-90ab-3d2594aae646" returned: 0 in 0.726s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.7b4e3bcf-bc14-4cd1-90ab-3d2594aae646 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:49 devstack sudo[84984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.7b4e3bcf-bc14-4cd1-90ab-3d2594aae646 Feb 27 02:04:49 devstack sudo[84984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c30ba23b-a901-4185-a92d-56fb3d605ace tempest-SnapshotsActionsTest-982775048 None] Acquiring lock "cinder-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c30ba23b-a901-4185-a92d-56fb3d605ace tempest-SnapshotsActionsTest-982775048 None] Lock "cinder-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c30ba23b-a901-4185-a92d-56fb3d605ace tempest-SnapshotsActionsTest-982775048 None] Acquiring lock "cinder-quobyte-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c30ba23b-a901-4185-a92d-56fb3d605ace tempest-SnapshotsActionsTest-982775048 None] Lock "cinder-quobyte-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" acquired by "delete_volume" :: waited 0.018s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:49 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[050f686d-d049-4458-b890-c1136f75bf6c]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c30ba23b-a901-4185-a92d-56fb3d605ace tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:49 devstack sudo[84986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c Feb 27 02:04:49 devstack sudo[84986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:50 devstack sudo[84984]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6.7b4e3bcf-bc14-4cd1-90ab-3d2594aae646" returned: 0 in 0.615s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:50 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] Lock "cinder-quobyte-7b4e3bcf-bc14-4cd1-90ab-3d2594aae646" released by "_delete_snapshot" :: held 2.853s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:50 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] Lock "cinder-quobyte-f4736348-bbb6-46b9-8a9e-63cff20a0ce6" released by "delete_snapshot" :: held 2.880s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:50 devstack cinder-volume[82738]: WARNING cinder.quota [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1056991409 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1056991409, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:04:50 devstack cinder-volume[82738]: WARNING cinder.quota [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1056991409 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1056991409, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:04:50 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] Created reservations ['67629c46-edba-45dc-986a-72c0fb21ccaf', '96dd0201-08c1-4b9c-ab78-2e93a5c80159', 'c692c729-4d25-4b5a-8e51-e3d2099e2beb', 'bdcb06a7-e6c2-4926-aa05-632714ab4931'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:50 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-9862125f-2b79-4999-b95a-0d86c3d7eebf tempest-GroupSnapshotsV319Test-633353559 None] group_snapshot a0714439-b602-4583-86d7-ffb85d92e84b: deleted successfully Feb 27 02:04:50 devstack sudo[84986]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c30ba23b-a901-4185-a92d-56fb3d605ace tempest-SnapshotsActionsTest-982775048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" returned: 0 in 0.679s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c30ba23b-a901-4185-a92d-56fb3d605ace tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:50 devstack sudo[84993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c Feb 27 02:04:50 devstack sudo[84993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:50 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5b445f9f-fc6b-4393-a7e7-d5378bc744cf tempest-GroupSnapshotsV319Test-633353559 None] Acquiring lock "cinder-quobyte-f4736348-bbb6-46b9-8a9e-63cff20a0ce6" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:50 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5b445f9f-fc6b-4393-a7e7-d5378bc744cf tempest-GroupSnapshotsV319Test-633353559 None] Lock "cinder-quobyte-f4736348-bbb6-46b9-8a9e-63cff20a0ce6" acquired by "delete_volume" :: waited 0.017s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:50 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47d3c35-85a5-4f8b-bc37-ac7bb240610b]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b445f9f-fc6b-4393-a7e7-d5378bc744cf tempest-GroupSnapshotsV319Test-633353559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:50 devstack sudo[84995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6 Feb 27 02:04:50 devstack sudo[84995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:51 devstack sudo[84993]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c30ba23b-a901-4185-a92d-56fb3d605ace tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" returned: 0 in 0.737s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:51 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c30ba23b-a901-4185-a92d-56fb3d605ace tempest-SnapshotsActionsTest-982775048 None] Lock "cinder-quobyte-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c" released by "delete_volume" :: held 1.471s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:51 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-c30ba23b-a901-4185-a92d-56fb3d605ace tempest-SnapshotsActionsTest-982775048 None] Created reservations ['4f4449cd-df2c-4cfc-99f6-1e82c3bf671d', 'c9d8c960-6f92-4a3d-9252-37bde9babffe', '72c9a515-b8f0-4ac7-8fb4-ffd9d1a1f003', '0d8fc3cf-0a45-4f76-9d8c-bfcc0427fabf'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c30ba23b-a901-4185-a92d-56fb3d605ace tempest-SnapshotsActionsTest-982775048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c30ba23b-a901-4185-a92d-56fb3d605ace tempest-SnapshotsActionsTest-982775048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-c30ba23b-a901-4185-a92d-56fb3d605ace tempest-SnapshotsActionsTest-982775048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-c30ba23b-a901-4185-a92d-56fb3d605ace tempest-SnapshotsActionsTest-982775048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c30ba23b-a901-4185-a92d-56fb3d605ace tempest-SnapshotsActionsTest-982775048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c30ba23b-a901-4185-a92d-56fb3d605ace tempest-SnapshotsActionsTest-982775048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:51 devstack sudo[84998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:04:51 devstack sudo[84998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:51 devstack sudo[84995]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b445f9f-fc6b-4393-a7e7-d5378bc744cf tempest-GroupSnapshotsV319Test-633353559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6" returned: 0 in 0.841s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b445f9f-fc6b-4393-a7e7-d5378bc744cf tempest-GroupSnapshotsV319Test-633353559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:51 devstack sudo[85003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6 Feb 27 02:04:51 devstack sudo[85003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:51 devstack sudo[84998]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c30ba23b-a901-4185-a92d-56fb3d605ace tempest-SnapshotsActionsTest-982775048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.556s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:51 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-c30ba23b-a901-4185-a92d-56fb3d605ace tempest-SnapshotsActionsTest-982775048 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:51 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-c30ba23b-a901-4185-a92d-56fb3d605ace tempest-SnapshotsActionsTest-982775048 None] Deleted volume successfully. Feb 27 02:04:51 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c30ba23b-a901-4185-a92d-56fb3d605ace tempest-SnapshotsActionsTest-982775048 None] Lock "cinder-cf5a2220-1bb3-4ee4-8f8c-a939e83efb0c-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:52 devstack sudo[85003]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b445f9f-fc6b-4393-a7e7-d5378bc744cf tempest-GroupSnapshotsV319Test-633353559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-f4736348-bbb6-46b9-8a9e-63cff20a0ce6" returned: 0 in 0.566s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:52 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5b445f9f-fc6b-4393-a7e7-d5378bc744cf tempest-GroupSnapshotsV319Test-633353559 None] Lock "cinder-quobyte-f4736348-bbb6-46b9-8a9e-63cff20a0ce6" released by "delete_volume" :: held 1.458s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:52 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=167,cinder:UPDATE=210,cinder:INSERT=41,cinder:DELETE=7 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:04:52 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-5b445f9f-fc6b-4393-a7e7-d5378bc744cf tempest-GroupSnapshotsV319Test-633353559 None] Created reservations ['e5826b65-1dc6-4e03-bab5-c445efcb20db'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:52 devstack cinder-volume[82738]: WARNING cinder.quota [None req-5b445f9f-fc6b-4393-a7e7-d5378bc744cf tempest-GroupSnapshotsV319Test-633353559 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1056991409 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1056991409, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:04:52 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-5b445f9f-fc6b-4393-a7e7-d5378bc744cf tempest-GroupSnapshotsV319Test-633353559 None] Created reservations ['dc2105ca-ced2-4af0-8656-0c7d86a9625e', 'bb7f391a-2663-41db-914a-9081367c2d8e', 'cf752d39-ed2c-4a61-9d34-ad5d0df591e5', '6fdb7409-395c-42a0-aa24-afdd4165e775'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5b445f9f-fc6b-4393-a7e7-d5378bc744cf tempest-GroupSnapshotsV319Test-633353559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5b445f9f-fc6b-4393-a7e7-d5378bc744cf tempest-GroupSnapshotsV319Test-633353559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:52 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5b445f9f-fc6b-4393-a7e7-d5378bc744cf tempest-GroupSnapshotsV319Test-633353559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:52 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5b445f9f-fc6b-4393-a7e7-d5378bc744cf tempest-GroupSnapshotsV319Test-633353559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5b445f9f-fc6b-4393-a7e7-d5378bc744cf tempest-GroupSnapshotsV319Test-633353559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b445f9f-fc6b-4393-a7e7-d5378bc744cf tempest-GroupSnapshotsV319Test-633353559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:52 devstack sudo[85007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:04:52 devstack sudo[85007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:53 devstack sudo[85007]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b445f9f-fc6b-4393-a7e7-d5378bc744cf tempest-GroupSnapshotsV319Test-633353559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.778s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-5b445f9f-fc6b-4393-a7e7-d5378bc744cf tempest-GroupSnapshotsV319Test-633353559 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:53 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-5b445f9f-fc6b-4393-a7e7-d5378bc744cf tempest-GroupSnapshotsV319Test-633353559 None] Delete group completed successfully. Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Flow 'volume_create_manager' (b1ef4682-ab2d-49cd-85a1-e3f3f574472c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161d7b90-286c-45c9-b706-ae800965918f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161d7b90-286c-45c9-b706-ae800965918f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-903039754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db16fc5-c408-4272-b8b8-dcb47837b470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f6e0cff404d4d9949234f07b6df1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:54Z,use_quota=True,user_id='55dd4f3efee44353a10fa725291836ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ddfcc1b-67cc-4e8e-bf40-317ba0c1d68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ddfcc1b-67cc-4e8e-bf40-317ba0c1d68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de48e0b9-a4bc-4777-b347-db3a40d3e82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de48e0b9-a4bc-4777-b347-db3a40d3e82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6db16fc5-c408-4272-b8b8-dcb47837b470', 'volume_name': 'volume-6db16fc5-c408-4272-b8b8-dcb47837b470', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b2ed4f-aa77-4cd9-9d4b-a1c196ff6481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b2ed4f-aa77-4cd9-9d4b-a1c196ff6481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a4afca-5803-4fd3-89bf-ebfd740b5116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:53 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Volume 6db16fc5-c408-4272-b8b8-dcb47837b470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6db16fc5-c408-4272-b8b8-dcb47837b470', 'volume_size': 1} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-903039754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db16fc5-c408-4272-b8b8-dcb47837b470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f6e0cff404d4d9949234f07b6df1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:54Z,use_quota=True,user_id='55dd4f3efee44353a10fa725291836ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Creating volume 6db16fc5-c408-4272-b8b8-dcb47837b470 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:53 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:04:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6db16fc5-c408-4272-b8b8-dcb47837b470 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:53 devstack sudo[85013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6db16fc5-c408-4272-b8b8-dcb47837b470 1073741824 Feb 27 02:04:53 devstack sudo[85013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:54 devstack sudo[85013]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6db16fc5-c408-4272-b8b8-dcb47837b470 1073741824" returned: 0 in 0.805s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6db16fc5-c408-4272-b8b8-dcb47837b470 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:54 devstack sudo[85018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6db16fc5-c408-4272-b8b8-dcb47837b470 Feb 27 02:04:54 devstack sudo[85018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:55 devstack sudo[85018]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6db16fc5-c408-4272-b8b8-dcb47837b470" returned: 0 in 0.689s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:55 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a4afca-5803-4fd3-89bf-ebfd740b5116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6db16fc5-c408-4272-b8b8-dcb47837b470', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401ecf3f-752a-40d9-a974-5b6ffb8dea18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:55 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Volume volume-6db16fc5-c408-4272-b8b8-dcb47837b470 (6db16fc5-c408-4272-b8b8-dcb47837b470): created successfully Feb 27 02:04:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401ecf3f-752a-40d9-a974-5b6ffb8dea18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Flow 'volume_create_manager' (b1ef4682-ab2d-49cd-85a1-e3f3f574472c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:55 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e7e742f0-c90b-4a19-920d-4d979c3aa331 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Created volume successfully. Feb 27 02:04:56 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9094863d-8945-47a0-af5c-053b63956845 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Acquiring lock "cinder-6db16fc5-c408-4272-b8b8-dcb47837b470-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:56 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9094863d-8945-47a0-af5c-053b63956845 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Lock "cinder-6db16fc5-c408-4272-b8b8-dcb47837b470-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:56 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9094863d-8945-47a0-af5c-053b63956845 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Acquiring lock "cinder-quobyte-6db16fc5-c408-4272-b8b8-dcb47837b470" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:56 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9094863d-8945-47a0-af5c-053b63956845 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Lock "cinder-quobyte-6db16fc5-c408-4272-b8b8-dcb47837b470" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:56 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c16a8ed-3445-478e-8246-2dc2beb97136]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9094863d-8945-47a0-af5c-053b63956845 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6db16fc5-c408-4272-b8b8-dcb47837b470 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:56 devstack sudo[85021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6db16fc5-c408-4272-b8b8-dcb47837b470 Feb 27 02:04:56 devstack sudo[85021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:56 devstack sudo[85021]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9094863d-8945-47a0-af5c-053b63956845 tempest-VolumeQuotasAdminTestJSON-1286073678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6db16fc5-c408-4272-b8b8-dcb47837b470" returned: 0 in 0.714s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9094863d-8945-47a0-af5c-053b63956845 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6db16fc5-c408-4272-b8b8-dcb47837b470 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:56 devstack sudo[85026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6db16fc5-c408-4272-b8b8-dcb47837b470 Feb 27 02:04:56 devstack sudo[85026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:57 devstack sudo[85026]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9094863d-8945-47a0-af5c-053b63956845 tempest-VolumeQuotasAdminTestJSON-1286073678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6db16fc5-c408-4272-b8b8-dcb47837b470" returned: 0 in 0.657s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:57 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9094863d-8945-47a0-af5c-053b63956845 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Lock "cinder-quobyte-6db16fc5-c408-4272-b8b8-dcb47837b470" released by "delete_volume" :: held 1.414s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:57 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-9094863d-8945-47a0-af5c-053b63956845 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Created reservations ['057d3283-8561-4713-b6d2-ea5f11b0d342', '5da59106-ddbf-427a-9b1a-2ca281a4fc68', '89906370-ce97-4aa3-a3c9-e1f9777bec91', '79b11918-c493-4c76-a536-ddb5572cd988'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9094863d-8945-47a0-af5c-053b63956845 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9094863d-8945-47a0-af5c-053b63956845 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:57 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9094863d-8945-47a0-af5c-053b63956845 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:57 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9094863d-8945-47a0-af5c-053b63956845 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9094863d-8945-47a0-af5c-053b63956845 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9094863d-8945-47a0-af5c-053b63956845 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:57 devstack sudo[85029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:04:57 devstack sudo[85029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:58 devstack sudo[85029]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9094863d-8945-47a0-af5c-053b63956845 tempest-VolumeQuotasAdminTestJSON-1286073678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.568s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:58 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-9094863d-8945-47a0-af5c-053b63956845 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:58 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-9094863d-8945-47a0-af5c-053b63956845 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Deleted volume successfully. Feb 27 02:04:58 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9094863d-8945-47a0-af5c-053b63956845 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Lock "cinder-6db16fc5-c408-4272-b8b8-dcb47837b470-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:58 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Flow 'volume_create_manager' (a646fd3f-40ce-4a4b-832c-68d657d92258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba002ad-c324-4126-94cf-391955d18a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba002ad-c324-4126-94cf-391955d18a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1243382377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eceead04-903e-4f8a-a051-ae498aaa16ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f6e0cff404d4d9949234f07b6df1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:59Z,use_quota=True,user_id='55dd4f3efee44353a10fa725291836ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ba7545-225b-4ae9-96bc-665852fa9363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ba7545-225b-4ae9-96bc-665852fa9363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db544ad0-2201-41a3-8c4f-dea01554fe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db544ad0-2201-41a3-8c4f-dea01554fe21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eceead04-903e-4f8a-a051-ae498aaa16ed', 'volume_name': 'volume-eceead04-903e-4f8a-a051-ae498aaa16ed', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d4bd424-4700-4a30-af9e-8fd69269d869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d4bd424-4700-4a30-af9e-8fd69269d869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a90302-4666-4b7d-b1b7-c7671885aef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:59 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Volume eceead04-903e-4f8a-a051-ae498aaa16ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eceead04-903e-4f8a-a051-ae498aaa16ed', 'volume_size': 1} Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1243382377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eceead04-903e-4f8a-a051-ae498aaa16ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f6e0cff404d4d9949234f07b6df1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:59Z,use_quota=True,user_id='55dd4f3efee44353a10fa725291836ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Creating volume eceead04-903e-4f8a-a051-ae498aaa16ed {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:59 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-eceead04-903e-4f8a-a051-ae498aaa16ed 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:59 devstack sudo[85032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-eceead04-903e-4f8a-a051-ae498aaa16ed 1073741824 Feb 27 02:04:59 devstack sudo[85032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:59 devstack sudo[85032]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-eceead04-903e-4f8a-a051-ae498aaa16ed 1073741824" returned: 0 in 0.910s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-eceead04-903e-4f8a-a051-ae498aaa16ed {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:00 devstack sudo[85050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-eceead04-903e-4f8a-a051-ae498aaa16ed Feb 27 02:05:00 devstack sudo[85050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:00 devstack sudo[85050]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-eceead04-903e-4f8a-a051-ae498aaa16ed" returned: 0 in 0.649s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a90302-4666-4b7d-b1b7-c7671885aef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eceead04-903e-4f8a-a051-ae498aaa16ed', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb96e98-2313-450f-98e6-3b85b3bba19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:00 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Volume volume-eceead04-903e-4f8a-a051-ae498aaa16ed (eceead04-903e-4f8a-a051-ae498aaa16ed): created successfully Feb 27 02:05:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb96e98-2313-450f-98e6-3b85b3bba19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Flow 'volume_create_manager' (a646fd3f-40ce-4a4b-832c-68d657d92258) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:00 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-db51da34-2270-4bdf-a01c-e9881539dcd4 tempest-VolumeQuotasAdminTestJSON-1286073678 None] Created volume successfully. Feb 27 02:05:01 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-138e9695-1fc4-4142-93ba-9c6c743d2223 tempest-VolumeQuotasAdminTestJSON-433786057 None] Transfer volume completed successfully. Feb 27 02:05:01 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=180,cinder:UPDATE=160,cinder:INSERT=50,cinder:DELETE=13 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:05:01 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Flow 'volume_create_manager' (a4a511bc-5891-4a29-a5ee-12df9a8b1420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b231baaf-0725-4965-a8e4-6d18a95ece9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b231baaf-0725-4965-a8e4-6d18a95ece9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-700999812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacb21b24f0d4422a91bd0c6ae9d666a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:02Z,use_quota=True,user_id='3301f782705242e5b2db311864552833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f15bf8-6fdd-4f96-89ad-96fedfe950ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f15bf8-6fdd-4f96-89ad-96fedfe950ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba9312de-e473-4ac1-8e37-34099aa6624c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba9312de-e473-4ac1-8e37-34099aa6624c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238', 'volume_name': 'volume-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0b597a-e4f5-4c99-a146-6f1b8cb3225d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0b597a-e4f5-4c99-a146-6f1b8cb3225d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c99cf780-cb3a-44dd-b788-baf09c2f1158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:02 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Volume 1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238', 'volume_size': 1} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-700999812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacb21b24f0d4422a91bd0c6ae9d666a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:02Z,use_quota=True,user_id='3301f782705242e5b2db311864552833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Creating volume 1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:02 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:02 devstack sudo[85057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238 1073741824 Feb 27 02:05:02 devstack sudo[85057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-70f5b806-662e-404b-93d0-2a282750ac40 tempest-VolumeQuotasAdminTestJSON-907883881 None] Acquiring lock "cinder-eceead04-903e-4f8a-a051-ae498aaa16ed-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:02 devstack sudo[85057]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238 1073741824" returned: 0 in 0.783s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-70f5b806-662e-404b-93d0-2a282750ac40 tempest-VolumeQuotasAdminTestJSON-907883881 None] Lock "cinder-eceead04-903e-4f8a-a051-ae498aaa16ed-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-70f5b806-662e-404b-93d0-2a282750ac40 tempest-VolumeQuotasAdminTestJSON-907883881 None] Acquiring lock "cinder-quobyte-eceead04-903e-4f8a-a051-ae498aaa16ed" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-70f5b806-662e-404b-93d0-2a282750ac40 tempest-VolumeQuotasAdminTestJSON-907883881 None] Lock "cinder-quobyte-eceead04-903e-4f8a-a051-ae498aaa16ed" acquired by "delete_volume" :: waited 0.024s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:02 devstack sudo[85062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238 Feb 27 02:05:02 devstack sudo[85062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2de7e91-9da0-4d7d-8640-b10a7113b760]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-70f5b806-662e-404b-93d0-2a282750ac40 tempest-VolumeQuotasAdminTestJSON-907883881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-eceead04-903e-4f8a-a051-ae498aaa16ed {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:03 devstack sudo[85064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-eceead04-903e-4f8a-a051-ae498aaa16ed Feb 27 02:05:03 devstack sudo[85064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:03 devstack sudo[85062]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238" returned: 0 in 0.620s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c99cf780-cb3a-44dd-b788-baf09c2f1158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd10316-d581-4baa-afbb-5a31fd6bd4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:03 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Volume volume-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238 (1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238): created successfully Feb 27 02:05:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd10316-d581-4baa-afbb-5a31fd6bd4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Flow 'volume_create_manager' (a4a511bc-5891-4a29-a5ee-12df9a8b1420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:03 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-946f7c9b-555e-446a-95f1-0dc0d9ad49aa tempest-VolumeQuotasNegativeTestJSON-356470888 None] Created volume successfully. Feb 27 02:05:03 devstack sudo[85064]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-70f5b806-662e-404b-93d0-2a282750ac40 tempest-VolumeQuotasAdminTestJSON-907883881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-eceead04-903e-4f8a-a051-ae498aaa16ed" returned: 0 in 0.704s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-70f5b806-662e-404b-93d0-2a282750ac40 tempest-VolumeQuotasAdminTestJSON-907883881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-eceead04-903e-4f8a-a051-ae498aaa16ed {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:03 devstack sudo[85073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-eceead04-903e-4f8a-a051-ae498aaa16ed Feb 27 02:05:03 devstack sudo[85073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:04 devstack sudo[85073]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-70f5b806-662e-404b-93d0-2a282750ac40 tempest-VolumeQuotasAdminTestJSON-907883881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-eceead04-903e-4f8a-a051-ae498aaa16ed" returned: 0 in 0.610s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-70f5b806-662e-404b-93d0-2a282750ac40 tempest-VolumeQuotasAdminTestJSON-907883881 None] Lock "cinder-quobyte-eceead04-903e-4f8a-a051-ae498aaa16ed" released by "delete_volume" :: held 1.349s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:04 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-70f5b806-662e-404b-93d0-2a282750ac40 tempest-VolumeQuotasAdminTestJSON-907883881 None] Created reservations ['c897d4cf-115a-498e-ab1b-da554d349342', '53c92350-fe70-4099-8b41-122d29e0832a', '2c66896a-ea35-447b-be7d-c91b7c9b412e', '04965b28-1648-4d1d-8550-934b52c52e0b'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-70f5b806-662e-404b-93d0-2a282750ac40 tempest-VolumeQuotasAdminTestJSON-907883881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-70f5b806-662e-404b-93d0-2a282750ac40 tempest-VolumeQuotasAdminTestJSON-907883881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-70f5b806-662e-404b-93d0-2a282750ac40 tempest-VolumeQuotasAdminTestJSON-907883881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-70f5b806-662e-404b-93d0-2a282750ac40 tempest-VolumeQuotasAdminTestJSON-907883881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-70f5b806-662e-404b-93d0-2a282750ac40 tempest-VolumeQuotasAdminTestJSON-907883881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-70f5b806-662e-404b-93d0-2a282750ac40 tempest-VolumeQuotasAdminTestJSON-907883881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:04 devstack sudo[85076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:05:04 devstack sudo[85076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:05 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d383c4b3-8cfe-49ad-81e4-cce488f16044 tempest-VolumeQuotasNegativeTestJSON-356470888 None] Acquiring lock "cinder-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:05 devstack sudo[85076]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:05 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d383c4b3-8cfe-49ad-81e4-cce488f16044 tempest-VolumeQuotasNegativeTestJSON-356470888 None] Lock "cinder-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-70f5b806-662e-404b-93d0-2a282750ac40 tempest-VolumeQuotasAdminTestJSON-907883881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.905s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:05 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-70f5b806-662e-404b-93d0-2a282750ac40 tempest-VolumeQuotasAdminTestJSON-907883881 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:05 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-70f5b806-662e-404b-93d0-2a282750ac40 tempest-VolumeQuotasAdminTestJSON-907883881 None] Deleted volume successfully. Feb 27 02:05:05 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d383c4b3-8cfe-49ad-81e4-cce488f16044 tempest-VolumeQuotasNegativeTestJSON-356470888 None] Acquiring lock "cinder-quobyte-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:05 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-70f5b806-662e-404b-93d0-2a282750ac40 tempest-VolumeQuotasAdminTestJSON-907883881 None] Lock "cinder-eceead04-903e-4f8a-a051-ae498aaa16ed-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:05 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d383c4b3-8cfe-49ad-81e4-cce488f16044 tempest-VolumeQuotasNegativeTestJSON-356470888 None] Lock "cinder-quobyte-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238" acquired by "delete_volume" :: waited 0.018s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:05 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a70c48d-7d23-49e5-98f6-b0de8b891033]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d383c4b3-8cfe-49ad-81e4-cce488f16044 tempest-VolumeQuotasNegativeTestJSON-356470888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:05 devstack sudo[85105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238 Feb 27 02:05:05 devstack sudo[85105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:06 devstack sudo[85105]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d383c4b3-8cfe-49ad-81e4-cce488f16044 tempest-VolumeQuotasNegativeTestJSON-356470888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238" returned: 0 in 0.965s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d383c4b3-8cfe-49ad-81e4-cce488f16044 tempest-VolumeQuotasNegativeTestJSON-356470888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:06 devstack sudo[85111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238 Feb 27 02:05:06 devstack sudo[85111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:07 devstack sudo[85111]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d383c4b3-8cfe-49ad-81e4-cce488f16044 tempest-VolumeQuotasNegativeTestJSON-356470888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238" returned: 0 in 0.847s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:07 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d383c4b3-8cfe-49ad-81e4-cce488f16044 tempest-VolumeQuotasNegativeTestJSON-356470888 None] Lock "cinder-quobyte-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238" released by "delete_volume" :: held 1.872s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:07 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-d383c4b3-8cfe-49ad-81e4-cce488f16044 tempest-VolumeQuotasNegativeTestJSON-356470888 None] Created reservations ['4a1e15b7-67c1-498a-8aef-d4f971247a04', '09e1d594-516f-4690-b0ef-399698a222d9', '220c246f-b6f7-4f04-9be8-c51f9ce432d2', '941a8d42-6a18-417f-a286-a25493b4f4d0'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d383c4b3-8cfe-49ad-81e4-cce488f16044 tempest-VolumeQuotasNegativeTestJSON-356470888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d383c4b3-8cfe-49ad-81e4-cce488f16044 tempest-VolumeQuotasNegativeTestJSON-356470888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d383c4b3-8cfe-49ad-81e4-cce488f16044 tempest-VolumeQuotasNegativeTestJSON-356470888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d383c4b3-8cfe-49ad-81e4-cce488f16044 tempest-VolumeQuotasNegativeTestJSON-356470888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d383c4b3-8cfe-49ad-81e4-cce488f16044 tempest-VolumeQuotasNegativeTestJSON-356470888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d383c4b3-8cfe-49ad-81e4-cce488f16044 tempest-VolumeQuotasNegativeTestJSON-356470888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:07 devstack sudo[85120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:05:07 devstack sudo[85120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:08 devstack sudo[85120]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d383c4b3-8cfe-49ad-81e4-cce488f16044 tempest-VolumeQuotasNegativeTestJSON-356470888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.935s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:08 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-d383c4b3-8cfe-49ad-81e4-cce488f16044 tempest-VolumeQuotasNegativeTestJSON-356470888 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:08 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-d383c4b3-8cfe-49ad-81e4-cce488f16044 tempest-VolumeQuotasNegativeTestJSON-356470888 None] Deleted volume successfully. Feb 27 02:05:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d383c4b3-8cfe-49ad-81e4-cce488f16044 tempest-VolumeQuotasNegativeTestJSON-356470888 None] Lock "cinder-1fc9bc1f-2e4c-4316-ba3e-f65a1e1a5238-delete_volume" released by "delete_volume" :: held 3.140s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Flow 'volume_create_manager' (e6cd0438-1ea2-455b-9fb6-52dac7f5e814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1c071b7-70f2-4070-a3e4-9f5cac8030ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1c071b7-70f2-4070-a3e4-9f5cac8030ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1681300308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff60b45-5c61-402e-becc-2baf82fe99f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85d046c287640f29b6b69a9e72b89b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:15Z,use_quota=True,user_id='84f394745ddb4db3a2fd078f9607c9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(399458b8-b6cc-4373-9182-6b2cdc4c49f2),volume_type_id=399458b8-b6cc-4373-9182-6b2cdc4c49f2)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1bede91-aa10-456d-98f0-ff35a05bebb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1bede91-aa10-456d-98f0-ff35a05bebb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae016c6-17be-42f6-8d04-bfd7f89c54a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae016c6-17be-42f6-8d04-bfd7f89c54a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ff60b45-5c61-402e-becc-2baf82fe99f0', 'volume_name': 'volume-6ff60b45-5c61-402e-becc-2baf82fe99f0', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597e5855-d87b-402c-9d9d-c3e56f99f426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597e5855-d87b-402c-9d9d-c3e56f99f426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c983c9a3-3660-4844-8458-e11745504e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:14 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Volume 6ff60b45-5c61-402e-becc-2baf82fe99f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ff60b45-5c61-402e-becc-2baf82fe99f0', 'volume_size': 1} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1681300308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff60b45-5c61-402e-becc-2baf82fe99f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85d046c287640f29b6b69a9e72b89b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:15Z,use_quota=True,user_id='84f394745ddb4db3a2fd078f9607c9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(399458b8-b6cc-4373-9182-6b2cdc4c49f2),volume_type_id=399458b8-b6cc-4373-9182-6b2cdc4c49f2)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Creating volume 6ff60b45-5c61-402e-becc-2baf82fe99f0 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:14 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ff60b45-5c61-402e-becc-2baf82fe99f0 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:14 devstack sudo[85153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ff60b45-5c61-402e-becc-2baf82fe99f0 1073741824 Feb 27 02:05:14 devstack sudo[85153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:14 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Flow 'volume_create_manager' (903c3455-d9f3-466d-bc24-b3bc39dc03c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d9fe7c-5029-48bc-9117-373ed69e701d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d9fe7c-5029-48bc-9117-373ed69e701d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-354534699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08f9b8e-0af7-47eb-9149-276bc68cc016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5619a166d0ae491d95949be7d3964ad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:15Z,use_quota=True,user_id='1051313909a349b08b0215259f1718e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9999282d-7ab1-4471-b456-ad91cbcc4e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9999282d-7ab1-4471-b456-ad91cbcc4e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b79b883-60b9-4c9c-bef8-0980f881099d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b79b883-60b9-4c9c-bef8-0980f881099d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd08f9b8e-0af7-47eb-9149-276bc68cc016', 'volume_name': 'volume-d08f9b8e-0af7-47eb-9149-276bc68cc016', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19406e31-b130-4fcf-9390-9f7034ae5f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19406e31-b130-4fcf-9390-9f7034ae5f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6709213c-5090-405a-8fd7-b44010d1675a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:15 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Volume d08f9b8e-0af7-47eb-9149-276bc68cc016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d08f9b8e-0af7-47eb-9149-276bc68cc016', 'volume_size': 1} Feb 27 02:05:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:15 devstack sudo[85153]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ff60b45-5c61-402e-becc-2baf82fe99f0 1073741824" returned: 0 in 0.804s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ff60b45-5c61-402e-becc-2baf82fe99f0 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:15 devstack sudo[85164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ff60b45-5c61-402e-becc-2baf82fe99f0 Feb 27 02:05:15 devstack sudo[85164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:16 devstack sudo[85164]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ff60b45-5c61-402e-becc-2baf82fe99f0" returned: 0 in 0.650s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.275s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-354534699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08f9b8e-0af7-47eb-9149-276bc68cc016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5619a166d0ae491d95949be7d3964ad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:15Z,use_quota=True,user_id='1051313909a349b08b0215259f1718e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Creating volume d08f9b8e-0af7-47eb-9149-276bc68cc016 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:16 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:05:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d08f9b8e-0af7-47eb-9149-276bc68cc016 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:16 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c983c9a3-3660-4844-8458-e11745504e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff60b45-5c61-402e-becc-2baf82fe99f0', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:16 devstack sudo[85167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d08f9b8e-0af7-47eb-9149-276bc68cc016 1073741824 Feb 27 02:05:16 devstack sudo[85167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:16 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed4d2b7-0189-4dd0-b737-2c1b65b71d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:16 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Volume volume-6ff60b45-5c61-402e-becc-2baf82fe99f0 (6ff60b45-5c61-402e-becc-2baf82fe99f0): created successfully Feb 27 02:05:16 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed4d2b7-0189-4dd0-b737-2c1b65b71d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:16 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Flow 'volume_create_manager' (e6cd0438-1ea2-455b-9fb6-52dac7f5e814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:16 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-0eaedde0-aef4-4a78-8c47-64b78fbd5492 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Created volume successfully. Feb 27 02:05:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b7acf87a-457d-440f-b931-b00fbffffe16 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b7acf87a-457d-440f-b931-b00fbffffe16 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:17 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b7acf87a-457d-440f-b931-b00fbffffe16 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:17 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b7acf87a-457d-440f-b931-b00fbffffe16 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b7acf87a-457d-440f-b931-b00fbffffe16 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b7acf87a-457d-440f-b931-b00fbffffe16 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:17 devstack sudo[85207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:05:17 devstack sudo[85207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:17 devstack sudo[85167]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d08f9b8e-0af7-47eb-9149-276bc68cc016 1073741824" returned: 0 in 1.285s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d08f9b8e-0af7-47eb-9149-276bc68cc016 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:17 devstack sudo[85209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d08f9b8e-0af7-47eb-9149-276bc68cc016 Feb 27 02:05:17 devstack sudo[85209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:18 devstack sudo[85207]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b7acf87a-457d-440f-b931-b00fbffffe16 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.853s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:18 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-b7acf87a-457d-440f-b931-b00fbffffe16 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:18 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-b7acf87a-457d-440f-b931-b00fbffffe16 tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Retype volume completed successfully. Feb 27 02:05:18 devstack sudo[85209]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d08f9b8e-0af7-47eb-9149-276bc68cc016" returned: 0 in 1.017s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:18 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] <== create_volume: return (2372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.378s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6709213c-5090-405a-8fd7-b44010d1675a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08f9b8e-0af7-47eb-9149-276bc68cc016', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739140bc-5328-4327-8a24-e544d62afb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:18 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Volume volume-d08f9b8e-0af7-47eb-9149-276bc68cc016 (d08f9b8e-0af7-47eb-9149-276bc68cc016): created successfully Feb 27 02:05:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739140bc-5328-4327-8a24-e544d62afb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Flow 'volume_create_manager' (903c3455-d9f3-466d-bc24-b3bc39dc03c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Acquiring lock "cinder-6ff60b45-5c61-402e-becc-2baf82fe99f0-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:18 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-a7fd2536-239c-4a0e-bce6-ff966732c5c2 tempest-VolumesServicesTestJSON-1228296535 None] Created volume successfully. Feb 27 02:05:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Lock "cinder-6ff60b45-5c61-402e-becc-2baf82fe99f0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Acquiring lock "cinder-quobyte-6ff60b45-5c61-402e-becc-2baf82fe99f0" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Lock "cinder-quobyte-6ff60b45-5c61-402e-becc-2baf82fe99f0" acquired by "delete_volume" :: waited 0.017s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:18 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[64935237-ae89-41de-8601-4e075871c87d]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ff60b45-5c61-402e-becc-2baf82fe99f0 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:19 devstack sudo[85213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ff60b45-5c61-402e-becc-2baf82fe99f0 Feb 27 02:05:19 devstack sudo[85213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:19 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9ca7b177-c710-4053-8c7b-be08c2ab048b tempest-VolumesServicesTestJSON-1228296535 None] Acquiring lock "cinder-d08f9b8e-0af7-47eb-9149-276bc68cc016-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:19 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9ca7b177-c710-4053-8c7b-be08c2ab048b tempest-VolumesServicesTestJSON-1228296535 None] Lock "cinder-d08f9b8e-0af7-47eb-9149-276bc68cc016-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:19 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9ca7b177-c710-4053-8c7b-be08c2ab048b tempest-VolumesServicesTestJSON-1228296535 None] Acquiring lock "cinder-quobyte-d08f9b8e-0af7-47eb-9149-276bc68cc016" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:19 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9ca7b177-c710-4053-8c7b-be08c2ab048b tempest-VolumesServicesTestJSON-1228296535 None] Lock "cinder-quobyte-d08f9b8e-0af7-47eb-9149-276bc68cc016" acquired by "delete_volume" :: waited 0.015s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:19 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6c7c62-e366-4698-a200-e959de4e7633]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9ca7b177-c710-4053-8c7b-be08c2ab048b tempest-VolumesServicesTestJSON-1228296535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d08f9b8e-0af7-47eb-9149-276bc68cc016 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:19 devstack sudo[85218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d08f9b8e-0af7-47eb-9149-276bc68cc016 Feb 27 02:05:19 devstack sudo[85218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:20 devstack sudo[85213]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ff60b45-5c61-402e-becc-2baf82fe99f0" returned: 0 in 1.148s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ff60b45-5c61-402e-becc-2baf82fe99f0 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:20 devstack sudo[85223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ff60b45-5c61-402e-becc-2baf82fe99f0 Feb 27 02:05:20 devstack sudo[85223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:20 devstack sudo[85218]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9ca7b177-c710-4053-8c7b-be08c2ab048b tempest-VolumesServicesTestJSON-1228296535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d08f9b8e-0af7-47eb-9149-276bc68cc016" returned: 0 in 1.047s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9ca7b177-c710-4053-8c7b-be08c2ab048b tempest-VolumesServicesTestJSON-1228296535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d08f9b8e-0af7-47eb-9149-276bc68cc016 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:20 devstack sudo[85229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d08f9b8e-0af7-47eb-9149-276bc68cc016 Feb 27 02:05:20 devstack sudo[85229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:21 devstack sudo[85223]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ff60b45-5c61-402e-becc-2baf82fe99f0" returned: 0 in 1.164s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:21 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Lock "cinder-quobyte-6ff60b45-5c61-402e-becc-2baf82fe99f0" released by "delete_volume" :: held 2.374s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:21 devstack cinder-volume[82738]: WARNING cinder.quota [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:21 devstack cinder-volume[82738]: WARNING cinder.quota [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:21 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Created reservations ['1617ff8c-bd8d-4fc8-be7b-571d51522549', '8ec34f4c-9a13-4f5e-b61b-0b99405e2dbc', '23a6ffee-be60-4831-87f5-935c8415462e', 'ae863009-2d15-4382-be57-455399cb5fd0'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:21 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:21 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:21 devstack sudo[85233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:05:21 devstack sudo[85233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:21 devstack sudo[85229]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9ca7b177-c710-4053-8c7b-be08c2ab048b tempest-VolumesServicesTestJSON-1228296535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d08f9b8e-0af7-47eb-9149-276bc68cc016" returned: 0 in 1.110s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:21 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9ca7b177-c710-4053-8c7b-be08c2ab048b tempest-VolumesServicesTestJSON-1228296535 None] Lock "cinder-quobyte-d08f9b8e-0af7-47eb-9149-276bc68cc016" released by "delete_volume" :: held 2.228s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:21 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-9ca7b177-c710-4053-8c7b-be08c2ab048b tempest-VolumesServicesTestJSON-1228296535 None] Created reservations ['95c03957-f5bb-4940-a5e9-ea369bb4fb8d', 'c51fb045-47d3-4ea0-a62e-78fe31f3465d', '994ca6f5-496f-4ce5-a17c-e1e1bdbf64b0', '564d515e-2b72-44b8-b29a-ecd9cc2ab5d6'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9ca7b177-c710-4053-8c7b-be08c2ab048b tempest-VolumesServicesTestJSON-1228296535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9ca7b177-c710-4053-8c7b-be08c2ab048b tempest-VolumesServicesTestJSON-1228296535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:21 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9ca7b177-c710-4053-8c7b-be08c2ab048b tempest-VolumesServicesTestJSON-1228296535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:21 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9ca7b177-c710-4053-8c7b-be08c2ab048b tempest-VolumesServicesTestJSON-1228296535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9ca7b177-c710-4053-8c7b-be08c2ab048b tempest-VolumesServicesTestJSON-1228296535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9ca7b177-c710-4053-8c7b-be08c2ab048b tempest-VolumesServicesTestJSON-1228296535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:21 devstack sudo[85236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:05:21 devstack sudo[85236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:22 devstack sudo[85233]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.968s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:22 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:22 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Deleted volume successfully. Feb 27 02:05:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7f9b0b56-d706-4ea1-bc71-b2a5adb3389f tempest-VolumeRetypeWithoutMigrationTest-66371786 None] Lock "cinder-6ff60b45-5c61-402e-becc-2baf82fe99f0-delete_volume" released by "delete_volume" :: held 3.658s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:22 devstack sudo[85236]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9ca7b177-c710-4053-8c7b-be08c2ab048b tempest-VolumesServicesTestJSON-1228296535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.802s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:22 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-9ca7b177-c710-4053-8c7b-be08c2ab048b tempest-VolumesServicesTestJSON-1228296535 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:22 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-9ca7b177-c710-4053-8c7b-be08c2ab048b tempest-VolumesServicesTestJSON-1228296535 None] Deleted volume successfully. Feb 27 02:05:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9ca7b177-c710-4053-8c7b-be08c2ab048b tempest-VolumesServicesTestJSON-1228296535 None] Lock "cinder-d08f9b8e-0af7-47eb-9149-276bc68cc016-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Flow 'volume_create_manager' (78e31da2-65de-497a-aee6-4d0ec535eabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfc551b-fcfc-4f61-b079-ca11ea635ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfc551b-fcfc-4f61-b079-ca11ea635ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1054695085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487ca80a-0761-4ac1-8b54-f73348e671b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522a472b5bea4a6e94b10f6640168b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:23Z,use_quota=True,user_id='6602d2357d7e4294be4d74bf1021679d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b078d90-ee15-496d-a7b4-64633e20ad9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b078d90-ee15-496d-a7b4-64633e20ad9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58763e5-ae6f-4bba-9db2-27e36bdc4701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58763e5-ae6f-4bba-9db2-27e36bdc4701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '487ca80a-0761-4ac1-8b54-f73348e671b6', 'volume_name': 'volume-487ca80a-0761-4ac1-8b54-f73348e671b6', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234e7ff7-c5cd-4724-943f-0b4cd2927b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234e7ff7-c5cd-4724-943f-0b4cd2927b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a894ffd-d147-46ca-9db8-802d35ae0546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:23 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Volume 487ca80a-0761-4ac1-8b54-f73348e671b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-487ca80a-0761-4ac1-8b54-f73348e671b6', 'volume_size': 1} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1054695085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487ca80a-0761-4ac1-8b54-f73348e671b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522a472b5bea4a6e94b10f6640168b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:23Z,use_quota=True,user_id='6602d2357d7e4294be4d74bf1021679d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Creating volume 487ca80a-0761-4ac1-8b54-f73348e671b6 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:23 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:23 devstack sudo[85240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6 1073741824 Feb 27 02:05:23 devstack sudo[85240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG oslo_service.periodic_task [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82738) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:23 devstack sudo[85242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:05:23 devstack sudo[85242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:24 devstack sudo[85240]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6 1073741824" returned: 0 in 0.895s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:24 devstack sudo[85247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6 Feb 27 02:05:24 devstack sudo[85247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:24 devstack sudo[85242]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 1.022s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:24 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:25 devstack sudo[85247]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6" returned: 0 in 1.268s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:25 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] <== create_volume: return (2222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.224s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:25 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a894ffd-d147-46ca-9db8-802d35ae0546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-487ca80a-0761-4ac1-8b54-f73348e671b6', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:25 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db359f6-68e8-48f7-97a0-32cd16f7b341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:25 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Volume volume-487ca80a-0761-4ac1-8b54-f73348e671b6 (487ca80a-0761-4ac1-8b54-f73348e671b6): created successfully Feb 27 02:05:25 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db359f6-68e8-48f7-97a0-32cd16f7b341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:25 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Flow 'volume_create_manager' (78e31da2-65de-497a-aee6-4d0ec535eabf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:25 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-f5607ec3-ea8e-453e-b99e-cf44599cbcdd tempest-VolumesDeleteCascade-637113945 None] Created volume successfully. Feb 27 02:05:25 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Flow 'volume_create_manager' (f3ab2cbc-3857-4432-92c2-292ff262f55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b99ddfd-084d-4766-b58d-93391557149c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b99ddfd-084d-4766-b58d-93391557149c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:26Z,deleted=False,deleted_at=None,display_description='',display_name='e52b8f36-345a-4d07-b788-9a42c9ebdc73-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d264f466-da73-495e-85f9-6734a8445c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f2eb4564344471a74f1556cc267200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:26Z,use_quota=True,user_id='a872712bbdfe46de983fba404eeda58d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf633ff-69df-4770-a897-4a0d864ae312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf633ff-69df-4770-a897-4a0d864ae312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa33952-46f5-4112-92ce-645e1c880585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa33952-46f5-4112-92ce-645e1c880585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd264f466-da73-495e-85f9-6734a8445c79', 'volume_name': 'volume-d264f466-da73-495e-85f9-6734a8445c79', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d115cdbf-a2fd-4c19-ae1c-483a27ef0d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d115cdbf-a2fd-4c19-ae1c-483a27ef0d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95ad582-cdf3-4378-9e33-04c8db3fe5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:26 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Volume d264f466-da73-495e-85f9-6734a8445c79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d264f466-da73-495e-85f9-6734a8445c79', 'volume_size': 1} Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:26Z,deleted=False,deleted_at=None,display_description='',display_name='e52b8f36-345a-4d07-b788-9a42c9ebdc73-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d264f466-da73-495e-85f9-6734a8445c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f2eb4564344471a74f1556cc267200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:26Z,use_quota=True,user_id='a872712bbdfe46de983fba404eeda58d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Creating volume d264f466-da73-495e-85f9-6734a8445c79 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:26 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d264f466-da73-495e-85f9-6734a8445c79 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:26 devstack sudo[85252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d264f466-da73-495e-85f9-6734a8445c79 1073741824 Feb 27 02:05:26 devstack sudo[85252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2a04bd9d-9e75-480a-9598-7beff5bc9ee0 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:27 devstack sudo[85252]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d264f466-da73-495e-85f9-6734a8445c79 1073741824" returned: 0 in 0.995s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d264f466-da73-495e-85f9-6734a8445c79 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:27 devstack sudo[85257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d264f466-da73-495e-85f9-6734a8445c79 Feb 27 02:05:27 devstack sudo[85257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:27 devstack sudo[85257]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d264f466-da73-495e-85f9-6734a8445c79" returned: 0 in 0.784s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:27 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2a04bd9d-9e75-480a-9598-7beff5bc9ee0 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.991s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95ad582-cdf3-4378-9e33-04c8db3fe5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d264f466-da73-495e-85f9-6734a8445c79', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e18d01-2da2-4c86-b23b-4c047ea8919d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:28 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Volume volume-d264f466-da73-495e-85f9-6734a8445c79 (d264f466-da73-495e-85f9-6734a8445c79): created successfully Feb 27 02:05:28 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e18d01-2da2-4c86-b23b-4c047ea8919d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:28 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Flow 'volume_create_manager' (f3ab2cbc-3857-4432-92c2-292ff262f55c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:28 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-2a04bd9d-9e75-480a-9598-7beff5bc9ee0 tempest-VolumesDeleteCascade-637113945 None] Creating offline snapshot 5c32d19b-1b30-418e-8d41-d623da25c244 of volume 487ca80a-0761-4ac1-8b54-f73348e671b6 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:05:28 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee70ec12-19a9-4eb1-bb6b-941ad1e12c99]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2a04bd9d-9e75-480a-9598-7beff5bc9ee0 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:28 devstack cinder-volume[82738]: INFO cinder.volume.manager [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-b9fedb80-6768-4536-96d1-d9f07501cfdc tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Created volume successfully. Feb 27 02:05:28 devstack sudo[85261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6 Feb 27 02:05:28 devstack sudo[85261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:29 devstack sudo[85261]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2a04bd9d-9e75-480a-9598-7beff5bc9ee0 tempest-VolumesDeleteCascade-637113945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6" returned: 0 in 0.965s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2a04bd9d-9e75-480a-9598-7beff5bc9ee0 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:29 devstack sudo[85267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 1G Feb 27 02:05:29 devstack sudo[85267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-47820fa9-b255-48be-99de-589a0455d816 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:30 devstack sudo[85267]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2a04bd9d-9e75-480a-9598-7beff5bc9ee0 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 1G" returned: 0 in 1.145s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2a04bd9d-9e75-480a-9598-7beff5bc9ee0 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487ca80a-0761-4ac1-8b54-f73348e671b6 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:30 devstack sudo[85280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487ca80a-0761-4ac1-8b54-f73348e671b6 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 Feb 27 02:05:30 devstack sudo[85280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:30 devstack sudo[85280]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2a04bd9d-9e75-480a-9598-7beff5bc9ee0 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487ca80a-0761-4ac1-8b54-f73348e671b6 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244" returned: 0 in 0.606s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:30 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-2a04bd9d-9e75-480a-9598-7beff5bc9ee0 tempest-VolumesDeleteCascade-637113945 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 is being set with open permissions: ugo+rw Feb 27 02:05:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2a04bd9d-9e75-480a-9598-7beff5bc9ee0 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:30 devstack sudo[85290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 Feb 27 02:05:30 devstack sudo[85290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:30 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Flow 'volume_create_manager' (6e1a0e6e-4cb2-4356-993e-54c3d916a867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5127c920-3582-4393-841a-5c82d910b0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5127c920-3582-4393-841a-5c82d910b0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1262910543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19637c81-ff91-416a-a66f-32089592f5e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd33705ce6a04b7899062574c314be9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:31Z,use_quota=True,user_id='c970ab36dfec4f5da3ce2664ec5f192f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a4e68c-738b-4b4b-9214-775257f8df4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a4e68c-738b-4b4b-9214-775257f8df4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d14c2513-9696-4778-85da-012a240b08f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d14c2513-9696-4778-85da-012a240b08f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19637c81-ff91-416a-a66f-32089592f5e4', 'volume_name': 'volume-19637c81-ff91-416a-a66f-32089592f5e4', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b2e2f5-7abc-4bfb-ab44-e74a2403fdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b2e2f5-7abc-4bfb-ab44-e74a2403fdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd7b833-7a8a-4418-ac09-470f6c1ed9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:30 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Volume 19637c81-ff91-416a-a66f-32089592f5e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19637c81-ff91-416a-a66f-32089592f5e4', 'volume_size': 1} Feb 27 02:05:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:31 devstack sudo[85290]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2a04bd9d-9e75-480a-9598-7beff5bc9ee0 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244" returned: 0 in 0.657s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2a04bd9d-9e75-480a-9598-7beff5bc9ee0 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:31 devstack sudo[85294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.info Feb 27 02:05:31 devstack sudo[85294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:32 devstack sudo[85294]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2a04bd9d-9e75-480a-9598-7beff5bc9ee0 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.info" returned: 0 in 0.623s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:32 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-2a04bd9d-9e75-480a-9598-7beff5bc9ee0 tempest-VolumesDeleteCascade-637113945 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.info is being set with open permissions: ugo+rw Feb 27 02:05:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2a04bd9d-9e75-480a-9598-7beff5bc9ee0 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:32 devstack sudo[85297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.info Feb 27 02:05:32 devstack sudo[85297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:32 devstack sudo[85297]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2a04bd9d-9e75-480a-9598-7beff5bc9ee0 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.info" returned: 0 in 0.755s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2a04bd9d-9e75-480a-9598-7beff5bc9ee0 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.906s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-47820fa9-b255-48be-99de-589a0455d816 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.229s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:32 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b37772-a79a-444b-913a-1a3ca88b22cd]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-47820fa9-b255-48be-99de-589a0455d816 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d264f466-da73-495e-85f9-6734a8445c79 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:32 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-2a04bd9d-9e75-480a-9598-7beff5bc9ee0 tempest-VolumesDeleteCascade-637113945 None] Create snapshot completed successfully Feb 27 02:05:32 devstack sudo[85303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d264f466-da73-495e-85f9-6734a8445c79 Feb 27 02:05:32 devstack sudo[85303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:33 devstack sudo[85303]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-47820fa9-b255-48be-99de-589a0455d816 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d264f466-da73-495e-85f9-6734a8445c79" returned: 0 in 0.629s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-47820fa9-b255-48be-99de-589a0455d816 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.649s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.550s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1262910543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19637c81-ff91-416a-a66f-32089592f5e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd33705ce6a04b7899062574c314be9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:31Z,use_quota=True,user_id='c970ab36dfec4f5da3ce2664ec5f192f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Creating volume 19637c81-ff91-416a-a66f-32089592f5e4 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:33 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:05:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-47820fa9-b255-48be-99de-589a0455d816 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf', 'name': 'volume-d264f466-da73-495e-85f9-6734a8445c79', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5915d823-ffce-4d73-b3da-811e21c40a35', 'enforce_multipath': True} {{(pid=82738) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 02:05:33 devstack sudo[85308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4 1073741824 Feb 27 02:05:33 devstack sudo[85308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:33 devstack cinder-volume[82738]: INFO cinder.volume.manager [req-5328f4bc-ac9a-467a-8d4d-1002b91614e3 req-47820fa9-b255-48be-99de-589a0455d816 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] attachment_update completed successfully. Feb 27 02:05:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e34d76b6-fb1a-46f2-a89f-cd2621c2d352 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:34 devstack sudo[85308]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4 1073741824" returned: 0 in 0.832s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:34 devstack sudo[85313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4 Feb 27 02:05:34 devstack sudo[85313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:34 devstack sudo[85313]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4" returned: 0 in 0.518s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:34 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e34d76b6-fb1a-46f2-a89f-cd2621c2d352 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.236s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-e34d76b6-fb1a-46f2-a89f-cd2621c2d352 tempest-VolumesDeleteCascade-637113945 None] Creating offline snapshot c631d882-cf77-47af-9dfb-a833d7002e37 of volume 487ca80a-0761-4ac1-8b54-f73348e671b6 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:05:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd7b833-7a8a-4418-ac09-470f6c1ed9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19637c81-ff91-416a-a66f-32089592f5e4', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbffec29-e531-4d72-8bb1-05cf7b147a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:35 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[8534d29b-d1a9-491a-a63f-6f7334f58e9c]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e34d76b6-fb1a-46f2-a89f-cd2621c2d352 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:35 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Volume volume-19637c81-ff91-416a-a66f-32089592f5e4 (19637c81-ff91-416a-a66f-32089592f5e4): created successfully Feb 27 02:05:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbffec29-e531-4d72-8bb1-05cf7b147a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Flow 'volume_create_manager' (6e1a0e6e-4cb2-4356-993e-54c3d916a867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:35 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-eba16c67-1bcf-45a6-9516-8dc488f38ed7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Created volume successfully. Feb 27 02:05:35 devstack sudo[85316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 Feb 27 02:05:35 devstack sudo[85316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cb325ad9-ce22-4ad6-82c5-f53a996a841d tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:36 devstack sudo[85316]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e34d76b6-fb1a-46f2-a89f-cd2621c2d352 tempest-VolumesDeleteCascade-637113945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244" returned: 0 in 0.955s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:36 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-e34d76b6-fb1a-46f2-a89f-cd2621c2d352 tempest-VolumesDeleteCascade-637113945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-487ca80a-0761-4ac1-8b54-f73348e671b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e34d76b6-fb1a-46f2-a89f-cd2621c2d352 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:36 devstack sudo[85388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37 1G Feb 27 02:05:36 devstack sudo[85388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:36 devstack sudo[85388]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e34d76b6-fb1a-46f2-a89f-cd2621c2d352 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37 1G" returned: 0 in 0.795s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e34d76b6-fb1a-46f2-a89f-cd2621c2d352 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:36 devstack sudo[85393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37 Feb 27 02:05:36 devstack sudo[85393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:37 devstack sudo[85393]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e34d76b6-fb1a-46f2-a89f-cd2621c2d352 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37" returned: 0 in 0.629s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:37 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-e34d76b6-fb1a-46f2-a89f-cd2621c2d352 tempest-VolumesDeleteCascade-637113945 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37 is being set with open permissions: ugo+rw Feb 27 02:05:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e34d76b6-fb1a-46f2-a89f-cd2621c2d352 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:37 devstack sudo[85401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37 Feb 27 02:05:37 devstack sudo[85401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:38 devstack sudo[85401]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e34d76b6-fb1a-46f2-a89f-cd2621c2d352 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37" returned: 0 in 0.565s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e34d76b6-fb1a-46f2-a89f-cd2621c2d352 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.038s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cb325ad9-ce22-4ad6-82c5-f53a996a841d tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.502s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:38 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-cb325ad9-ce22-4ad6-82c5-f53a996a841d tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Creating offline snapshot 18c2ecae-549a-4c30-aca9-5128c4641ff6 of volume 19637c81-ff91-416a-a66f-32089592f5e4 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:05:38 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[47328341-e45d-499e-a28c-faadb38f1bf7]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb325ad9-ce22-4ad6-82c5-f53a996a841d tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:38 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e34d76b6-fb1a-46f2-a89f-cd2621c2d352 tempest-VolumesDeleteCascade-637113945 None] Create snapshot completed successfully Feb 27 02:05:38 devstack sudo[85404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4 Feb 27 02:05:38 devstack sudo[85404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:39 devstack sudo[85404]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb325ad9-ce22-4ad6-82c5-f53a996a841d tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4" returned: 0 in 0.955s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb325ad9-ce22-4ad6-82c5-f53a996a841d tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.18c2ecae-549a-4c30-aca9-5128c4641ff6 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:39 devstack sudo[85746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.18c2ecae-549a-4c30-aca9-5128c4641ff6 1G Feb 27 02:05:39 devstack sudo[85746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:39 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "cinder-487ca80a-0761-4ac1-8b54-f73348e671b6-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:39 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-487ca80a-0761-4ac1-8b54-f73348e671b6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:39 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Performing cascade delete. {{(pid=82738) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 27 02:05:39 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "cinder-5c32d19b-1b30-418e-8d41-d623da25c244-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:39 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-5c32d19b-1b30-418e-8d41-d623da25c244-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:39 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "cinder-quobyte-487ca80a-0761-4ac1-8b54-f73348e671b6" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:39 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-487ca80a-0761-4ac1-8b54-f73348e671b6" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:39 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "cinder-quobyte-5c32d19b-1b30-418e-8d41-d623da25c244" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:39 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-5c32d19b-1b30-418e-8d41-d623da25c244" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:39 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Deleting offline snapshot 5c32d19b-1b30-418e-8d41-d623da25c244 of volume 487ca80a-0761-4ac1-8b54-f73348e671b6 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:05:39 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] snapshot_file for this snap is: volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:05:39 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[417e7bf2-2152-4fe4-8f41-96af5f6f2cc0]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:39 devstack sudo[85748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 Feb 27 02:05:39 devstack sudo[85748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:40 devstack sudo[85748]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244" returned: 0 in 0.964s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:40 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-487ca80a-0761-4ac1-8b54-f73348e671b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:40 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03670f7-b992-4c08-af30-e62c82770791]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:40 devstack sudo[85746]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb325ad9-ce22-4ad6-82c5-f53a996a841d tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.18c2ecae-549a-4c30-aca9-5128c4641ff6 1G" returned: 0 in 1.452s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb325ad9-ce22-4ad6-82c5-f53a996a841d tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19637c81-ff91-416a-a66f-32089592f5e4 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.18c2ecae-549a-4c30-aca9-5128c4641ff6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:40 devstack sudo[85761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19637c81-ff91-416a-a66f-32089592f5e4 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.18c2ecae-549a-4c30-aca9-5128c4641ff6 Feb 27 02:05:40 devstack sudo[85761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:40 devstack sudo[85760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6 Feb 27 02:05:40 devstack sudo[85760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:41 devstack sudo[85760]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6" returned: 0 in 0.753s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:41 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e89131-e605-4605-98c7-d2abf0cfa9ff]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:41 devstack sudo[85761]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb325ad9-ce22-4ad6-82c5-f53a996a841d tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19637c81-ff91-416a-a66f-32089592f5e4 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.18c2ecae-549a-4c30-aca9-5128c4641ff6" returned: 0 in 0.825s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:41 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-cb325ad9-ce22-4ad6-82c5-f53a996a841d tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.18c2ecae-549a-4c30-aca9-5128c4641ff6 is being set with open permissions: ugo+rw Feb 27 02:05:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb325ad9-ce22-4ad6-82c5-f53a996a841d tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.18c2ecae-549a-4c30-aca9-5128c4641ff6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:41 devstack sudo[85770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37 Feb 27 02:05:41 devstack sudo[85770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:41 devstack sudo[85771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.18c2ecae-549a-4c30-aca9-5128c4641ff6 Feb 27 02:05:41 devstack sudo[85771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:42 devstack sudo[85770]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37" returned: 0 in 0.820s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:42 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-487ca80a-0761-4ac1-8b54-f73348e671b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:42 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f70a9f-a1a6-4646-997f-b0168168abc4]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:42 devstack sudo[85771]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb325ad9-ce22-4ad6-82c5-f53a996a841d tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.18c2ecae-549a-4c30-aca9-5128c4641ff6" returned: 0 in 0.913s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb325ad9-ce22-4ad6-82c5-f53a996a841d tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:42 devstack sudo[85777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 Feb 27 02:05:42 devstack sudo[85777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:42 devstack sudo[85779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.info Feb 27 02:05:42 devstack sudo[85779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:43 devstack sudo[85779]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb325ad9-ce22-4ad6-82c5-f53a996a841d tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.info" returned: 0 in 0.766s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:43 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-cb325ad9-ce22-4ad6-82c5-f53a996a841d tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.info is being set with open permissions: ugo+rw Feb 27 02:05:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb325ad9-ce22-4ad6-82c5-f53a996a841d tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:43 devstack sudo[85786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.info Feb 27 02:05:43 devstack sudo[85786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:43 devstack sudo[85777]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244" returned: 0 in 1.156s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:43 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-487ca80a-0761-4ac1-8b54-f73348e671b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:43 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[b310b024-d1c3-41ae-8286-6a60713d1c45]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:43 devstack sudo[85788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6 Feb 27 02:05:43 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:43 devstack sudo[85786]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cb325ad9-ce22-4ad6-82c5-f53a996a841d tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.info" returned: 0 in 0.812s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cb325ad9-ce22-4ad6-82c5-f53a996a841d tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.834s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:43 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6" returned: 0 in 0.704s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:43 devstack sudo[85794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 Feb 27 02:05:43 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:44 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-cb325ad9-ce22-4ad6-82c5-f53a996a841d tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Create snapshot completed successfully Feb 27 02:05:44 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244" returned: 0 in 0.684s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:44 devstack sudo[85799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244 Feb 27 02:05:44 devstack sudo[85799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:45 devstack sudo[85799]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.5c32d19b-1b30-418e-8d41-d623da25c244" returned: 0 in 0.609s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487ca80a-0761-4ac1-8b54-f73348e671b6 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37 -F qcow2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:45 devstack sudo[85802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487ca80a-0761-4ac1-8b54-f73348e671b6 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37 -F qcow2 Feb 27 02:05:45 devstack sudo[85802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Acquiring lock "cinder-18c2ecae-549a-4c30-aca9-5128c4641ff6-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Lock "cinder-18c2ecae-549a-4c30-aca9-5128c4641ff6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Acquiring lock "cinder-quobyte-19637c81-ff91-416a-a66f-32089592f5e4" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Lock "cinder-quobyte-19637c81-ff91-416a-a66f-32089592f5e4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Acquiring lock "cinder-quobyte-18c2ecae-549a-4c30-aca9-5128c4641ff6" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Lock "cinder-quobyte-18c2ecae-549a-4c30-aca9-5128c4641ff6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Deleting offline snapshot 18c2ecae-549a-4c30-aca9-5128c4641ff6 of volume 19637c81-ff91-416a-a66f-32089592f5e4 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:05:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] snapshot_file for this snap is: volume-19637c81-ff91-416a-a66f-32089592f5e4.18c2ecae-549a-4c30-aca9-5128c4641ff6 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:05:45 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d86bd4-5254-4228-bd65-7e5d0927d497]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.18c2ecae-549a-4c30-aca9-5128c4641ff6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:45 devstack sudo[85804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.18c2ecae-549a-4c30-aca9-5128c4641ff6 Feb 27 02:05:45 devstack sudo[85804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:45 devstack sudo[85802]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487ca80a-0761-4ac1-8b54-f73348e671b6 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37 -F qcow2" returned: 0 in 0.615s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-5c32d19b-1b30-418e-8d41-d623da25c244" released by "_delete_snapshot" :: held 6.467s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-487ca80a-0761-4ac1-8b54-f73348e671b6" released by "delete_snapshot" :: held 6.512s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:45 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Created reservations ['af7eee7d-9983-4b68-82db-1fbe4ddd23ac', 'ff389113-fbe4-427a-a86c-6baea07aa44d', '21b478f5-aeb2-4a75-a1b4-3a5acd088235', '6926175d-2ea2-4937-8f6a-6d8dd7be57d9'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:46 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Delete snapshot completed successfully. Feb 27 02:05:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-5c32d19b-1b30-418e-8d41-d623da25c244-delete_snapshot" released by "delete_snapshot" :: held 6.703s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "cinder-c631d882-cf77-47af-9dfb-a833d7002e37-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-c631d882-cf77-47af-9dfb-a833d7002e37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "cinder-quobyte-487ca80a-0761-4ac1-8b54-f73348e671b6" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-487ca80a-0761-4ac1-8b54-f73348e671b6" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "cinder-quobyte-c631d882-cf77-47af-9dfb-a833d7002e37" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-c631d882-cf77-47af-9dfb-a833d7002e37" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Deleting offline snapshot c631d882-cf77-47af-9dfb-a833d7002e37 of volume 487ca80a-0761-4ac1-8b54-f73348e671b6 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:05:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] snapshot_file for this snap is: volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:05:46 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bdb4c8-3c27-4917-91ff-64abbfad6f89]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:46 devstack sudo[85809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37 Feb 27 02:05:46 devstack sudo[85809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:46 devstack sudo[85804]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.18c2ecae-549a-4c30-aca9-5128c4641ff6" returned: 0 in 0.858s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19637c81-ff91-416a-a66f-32089592f5e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:46 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d42aa4-5793-44a1-9c22-882c37d9533f]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:46 devstack sudo[85814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4 Feb 27 02:05:46 devstack sudo[85814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:46 devstack sudo[85809]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37" returned: 0 in 0.659s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-487ca80a-0761-4ac1-8b54-f73348e671b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:46 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ae6431-fc48-4494-b297-cfe0e0e09dde]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:46 devstack sudo[85819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6 Feb 27 02:05:46 devstack sudo[85819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:46 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Flow 'volume_create_manager' (c88522f3-57d3-4cf1-ac6b-561b0fd95661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580a836a-80c0-4581-a2e3-18b45bf25bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580a836a-80c0-4581-a2e3-18b45bf25bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-554870645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3407ed7-69f6-44ae-8197-31a25b778dba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7ffad28b9f4430f89b1c9a8b4c202a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:47Z,use_quota=True,user_id='fe665907b7a9458ab7b397b6ccb2b201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb6e445-598f-478f-9ab4-c3f60da57798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb6e445-598f-478f-9ab4-c3f60da57798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60cc63c0-d87e-48af-84a8-d98b3fe23638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60cc63c0-d87e-48af-84a8-d98b3fe23638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3407ed7-69f6-44ae-8197-31a25b778dba', 'volume_name': 'volume-e3407ed7-69f6-44ae-8197-31a25b778dba', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db01631f-cbdf-499e-9101-934c076d18f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db01631f-cbdf-499e-9101-934c076d18f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064b3fff-2723-43d5-b985-becac661359f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:47 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Volume e3407ed7-69f6-44ae-8197-31a25b778dba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3407ed7-69f6-44ae-8197-31a25b778dba', 'volume_size': 1} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-554870645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3407ed7-69f6-44ae-8197-31a25b778dba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7ffad28b9f4430f89b1c9a8b4c202a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:47Z,use_quota=True,user_id='fe665907b7a9458ab7b397b6ccb2b201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Creating volume e3407ed7-69f6-44ae-8197-31a25b778dba {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:47 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e3407ed7-69f6-44ae-8197-31a25b778dba 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:47 devstack sudo[85814]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4" returned: 0 in 0.718s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.18c2ecae-549a-4c30-aca9-5128c4641ff6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:47 devstack sudo[85830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e3407ed7-69f6-44ae-8197-31a25b778dba 1073741824 Feb 27 02:05:47 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:47 devstack sudo[85831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.18c2ecae-549a-4c30-aca9-5128c4641ff6 Feb 27 02:05:47 devstack sudo[85831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:47 devstack sudo[85819]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6" returned: 0 in 0.674s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:47 devstack sudo[85855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37 Feb 27 02:05:47 devstack sudo[85855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:47 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e3407ed7-69f6-44ae-8197-31a25b778dba 1073741824" returned: 0 in 0.771s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:47 devstack sudo[85831]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.18c2ecae-549a-4c30-aca9-5128c4641ff6" returned: 0 in 0.789s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.18c2ecae-549a-4c30-aca9-5128c4641ff6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e3407ed7-69f6-44ae-8197-31a25b778dba {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:47 devstack sudo[85864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.18c2ecae-549a-4c30-aca9-5128c4641ff6 Feb 27 02:05:47 devstack sudo[85864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:47 devstack sudo[85866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e3407ed7-69f6-44ae-8197-31a25b778dba Feb 27 02:05:47 devstack sudo[85866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:48 devstack sudo[85855]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37" returned: 0 in 0.723s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:48 devstack sudo[85871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37 Feb 27 02:05:48 devstack sudo[85871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:48 devstack sudo[85864]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4.18c2ecae-549a-4c30-aca9-5128c4641ff6" returned: 0 in 0.525s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:48 devstack sudo[85866]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e3407ed7-69f6-44ae-8197-31a25b778dba" returned: 0 in 0.511s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064b3fff-2723-43d5-b985-becac661359f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3407ed7-69f6-44ae-8197-31a25b778dba', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d36ea7-d4ab-4130-b3b1-9490280d3c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Lock "cinder-quobyte-18c2ecae-549a-4c30-aca9-5128c4641ff6" released by "_delete_snapshot" :: held 3.007s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Lock "cinder-quobyte-19637c81-ff91-416a-a66f-32089592f5e4" released by "delete_snapshot" :: held 3.026s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:48 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Volume volume-e3407ed7-69f6-44ae-8197-31a25b778dba (e3407ed7-69f6-44ae-8197-31a25b778dba): created successfully Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d36ea7-d4ab-4130-b3b1-9490280d3c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Flow 'volume_create_manager' (c88522f3-57d3-4cf1-ac6b-561b0fd95661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Created reservations ['1bec139e-d353-42db-a822-fe12fb98466c', 'c89dd95d-70d6-45bd-95ef-9688c513f886', '1abc7459-b171-47b9-ac0e-a01c3a696d63', '14c26c7b-df4b-435a-b68c-d5b47700bd62'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:48 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-69e887ee-3b2d-4782-a7cb-1063b7b65f02 tempest-VolumesMetadataTest-98072096 None] Created volume successfully. Feb 27 02:05:48 devstack sudo[85871]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6.c631d882-cf77-47af-9dfb-a833d7002e37" returned: 0 in 0.620s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-c631d882-cf77-47af-9dfb-a833d7002e37" released by "_delete_snapshot" :: held 2.774s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-487ca80a-0761-4ac1-8b54-f73348e671b6" released by "delete_snapshot" :: held 2.795s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:48 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Delete snapshot completed successfully. Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f3b62802-c98b-49b4-90ae-005bda6977d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Lock "cinder-18c2ecae-549a-4c30-aca9-5128c4641ff6-delete_snapshot" released by "delete_snapshot" :: held 3.404s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Created reservations ['c4a1ef5f-a01c-41d4-8125-ab836b3fafe3', '744f3e41-0076-4f99-9c5c-c944d8cd08dc', 'eead7372-1641-4812-a37a-6a6e71ac2668', '4b4fa02a-c310-456b-bef7-79fc7282a737'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:48 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Delete snapshot completed successfully. Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-c631d882-cf77-47af-9dfb-a833d7002e37-delete_snapshot" released by "delete_snapshot" :: held 2.959s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Snapshots deleted, issuing volume delete {{(pid=82738) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 27 02:05:48 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "cinder-quobyte-487ca80a-0761-4ac1-8b54-f73348e671b6" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-487ca80a-0761-4ac1-8b54-f73348e671b6" acquired by "delete_volume" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:49 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[868b7e85-453c-46a5-bc6a-ede0df777c55]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:49 devstack sudo[85877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6 Feb 27 02:05:49 devstack sudo[85877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:49 devstack sudo[85877]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6" returned: 0 in 0.650s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:49 devstack sudo[85900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6 Feb 27 02:05:49 devstack sudo[85900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c6dc2c25-b8d5-45d3-818b-0aadf03e0709 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Acquiring lock "cinder-19637c81-ff91-416a-a66f-32089592f5e4-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c6dc2c25-b8d5-45d3-818b-0aadf03e0709 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Lock "cinder-19637c81-ff91-416a-a66f-32089592f5e4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c6dc2c25-b8d5-45d3-818b-0aadf03e0709 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Acquiring lock "cinder-quobyte-19637c81-ff91-416a-a66f-32089592f5e4" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c6dc2c25-b8d5-45d3-818b-0aadf03e0709 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Lock "cinder-quobyte-19637c81-ff91-416a-a66f-32089592f5e4" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:49 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8c6150-4073-4477-be8e-eec28d535401]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c6dc2c25-b8d5-45d3-818b-0aadf03e0709 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c0add95e-47fa-4976-a918-a653935e2ab0 tempest-VolumesMetadataTest-98072096 None] Acquiring lock "cinder-e3407ed7-69f6-44ae-8197-31a25b778dba-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c0add95e-47fa-4976-a918-a653935e2ab0 tempest-VolumesMetadataTest-98072096 None] Lock "cinder-e3407ed7-69f6-44ae-8197-31a25b778dba-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c0add95e-47fa-4976-a918-a653935e2ab0 tempest-VolumesMetadataTest-98072096 None] Acquiring lock "cinder-quobyte-e3407ed7-69f6-44ae-8197-31a25b778dba" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c0add95e-47fa-4976-a918-a653935e2ab0 tempest-VolumesMetadataTest-98072096 None] Lock "cinder-quobyte-e3407ed7-69f6-44ae-8197-31a25b778dba" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:49 devstack sudo[85902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4 Feb 27 02:05:49 devstack sudo[85902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:49 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76622fb-2a03-42a0-adf1-38d523676561]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c0add95e-47fa-4976-a918-a653935e2ab0 tempest-VolumesMetadataTest-98072096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e3407ed7-69f6-44ae-8197-31a25b778dba {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:50 devstack sudo[85904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e3407ed7-69f6-44ae-8197-31a25b778dba Feb 27 02:05:50 devstack sudo[85904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:50 devstack sudo[85900]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-487ca80a-0761-4ac1-8b54-f73348e671b6" returned: 0 in 0.593s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:50 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-487ca80a-0761-4ac1-8b54-f73348e671b6" released by "delete_volume" :: held 1.290s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:50 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Created reservations ['d07bc989-d084-48bb-9927-f0d3d38c5b3c', 'df0bae56-258e-4cbf-93bc-7377f863d900', 'db105be0-4f82-43a9-b71e-efedb75a894f', '7fbd999b-c911-4c59-8bfa-57157722dbba'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:50 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:50 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:50 devstack sudo[85910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:05:50 devstack sudo[85910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:50 devstack sudo[85902]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c6dc2c25-b8d5-45d3-818b-0aadf03e0709 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4" returned: 0 in 0.644s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c6dc2c25-b8d5-45d3-818b-0aadf03e0709 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:50 devstack sudo[85913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4 Feb 27 02:05:50 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:50 devstack sudo[85904]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c0add95e-47fa-4976-a918-a653935e2ab0 tempest-VolumesMetadataTest-98072096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e3407ed7-69f6-44ae-8197-31a25b778dba" returned: 0 in 0.659s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c0add95e-47fa-4976-a918-a653935e2ab0 tempest-VolumesMetadataTest-98072096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e3407ed7-69f6-44ae-8197-31a25b778dba {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:50 devstack sudo[85918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e3407ed7-69f6-44ae-8197-31a25b778dba Feb 27 02:05:50 devstack sudo[85918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:51 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c6dc2c25-b8d5-45d3-818b-0aadf03e0709 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-19637c81-ff91-416a-a66f-32089592f5e4" returned: 0 in 0.503s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c6dc2c25-b8d5-45d3-818b-0aadf03e0709 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Lock "cinder-quobyte-19637c81-ff91-416a-a66f-32089592f5e4" released by "delete_volume" :: held 1.204s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-c6dc2c25-b8d5-45d3-818b-0aadf03e0709 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Created reservations ['b001afa6-6e58-48d6-8b95-32f5081c014d', '02a00e09-9a20-4f3c-9631-09ae365bbe79', 'b9a29606-e52f-473e-b84b-07bd94bb23c5', '0b6880be-ade5-4b23-a2d1-e1717ae9b095'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:51 devstack sudo[85910]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.739s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:51 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Deleted volume successfully. Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c6dc2c25-b8d5-45d3-818b-0aadf03e0709 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c6dc2c25-b8d5-45d3-818b-0aadf03e0709 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-c6dc2c25-b8d5-45d3-818b-0aadf03e0709 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-c6dc2c25-b8d5-45d3-818b-0aadf03e0709 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c6dc2c25-b8d5-45d3-818b-0aadf03e0709 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c6dc2c25-b8d5-45d3-818b-0aadf03e0709 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8397f8a6-3ee0-4ce7-b825-892770910772 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-487ca80a-0761-4ac1-8b54-f73348e671b6-delete_volume" released by "delete_volume" :: held 11.992s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:51 devstack sudo[85923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:05:51 devstack sudo[85923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:51 devstack sudo[85918]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c0add95e-47fa-4976-a918-a653935e2ab0 tempest-VolumesMetadataTest-98072096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e3407ed7-69f6-44ae-8197-31a25b778dba" returned: 0 in 0.635s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c0add95e-47fa-4976-a918-a653935e2ab0 tempest-VolumesMetadataTest-98072096 None] Lock "cinder-quobyte-e3407ed7-69f6-44ae-8197-31a25b778dba" released by "delete_volume" :: held 1.330s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-c0add95e-47fa-4976-a918-a653935e2ab0 tempest-VolumesMetadataTest-98072096 None] Created reservations ['a0a160a4-3a79-4895-8412-c41972e35734', 'ffdec371-d080-4a5e-8e6b-88aab8bce8b6', '7a0a53ca-52df-49e2-b74b-d960a6dc3a7d', '59f93a48-b1b8-4892-9bdd-8937510f18ec'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c0add95e-47fa-4976-a918-a653935e2ab0 tempest-VolumesMetadataTest-98072096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c0add95e-47fa-4976-a918-a653935e2ab0 tempest-VolumesMetadataTest-98072096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-c0add95e-47fa-4976-a918-a653935e2ab0 tempest-VolumesMetadataTest-98072096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-c0add95e-47fa-4976-a918-a653935e2ab0 tempest-VolumesMetadataTest-98072096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c0add95e-47fa-4976-a918-a653935e2ab0 tempest-VolumesMetadataTest-98072096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c0add95e-47fa-4976-a918-a653935e2ab0 tempest-VolumesMetadataTest-98072096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:51 devstack sudo[85925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:05:51 devstack sudo[85925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Flow 'volume_create_manager' (a41b3eb9-5f5c-477e-a030-514c63be65de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbd8ff2-e39f-4f15-aef2-c166ab1e19b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbd8ff2-e39f-4f15-aef2-c166ab1e19b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-532223728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69f3a557-9c92-4ee6-8636-db3efd7bacaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522a472b5bea4a6e94b10f6640168b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:52Z,use_quota=True,user_id='6602d2357d7e4294be4d74bf1021679d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4804df0-8334-4caf-98c6-a8adf1c96d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4804df0-8334-4caf-98c6-a8adf1c96d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd2bd79c-4eb8-490d-ae47-dc7b2c936094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd2bd79c-4eb8-490d-ae47-dc7b2c936094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69f3a557-9c92-4ee6-8636-db3efd7bacaf', 'volume_name': 'volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099d9fe0-7212-4164-8b2a-01453d2176d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099d9fe0-7212-4164-8b2a-01453d2176d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8604b64a-9948-4c86-8ebf-ede57e0d9509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:51 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Volume 69f3a557-9c92-4ee6-8636-db3efd7bacaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf', 'volume_size': 1} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-532223728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69f3a557-9c92-4ee6-8636-db3efd7bacaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522a472b5bea4a6e94b10f6640168b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:52Z,use_quota=True,user_id='6602d2357d7e4294be4d74bf1021679d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Creating volume 69f3a557-9c92-4ee6-8636-db3efd7bacaf {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:52 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:52 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:05:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:52 devstack sudo[85929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf 1073741824 Feb 27 02:05:52 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:52 devstack sudo[85925]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c0add95e-47fa-4976-a918-a653935e2ab0 tempest-VolumesMetadataTest-98072096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.699s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:52 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-c0add95e-47fa-4976-a918-a653935e2ab0 tempest-VolumesMetadataTest-98072096 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:52 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-c0add95e-47fa-4976-a918-a653935e2ab0 tempest-VolumesMetadataTest-98072096 None] Deleted volume successfully. Feb 27 02:05:52 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c0add95e-47fa-4976-a918-a653935e2ab0 tempest-VolumesMetadataTest-98072096 None] Lock "cinder-e3407ed7-69f6-44ae-8197-31a25b778dba-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:52 devstack sudo[85923]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c6dc2c25-b8d5-45d3-818b-0aadf03e0709 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 1.049s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:52 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-c6dc2c25-b8d5-45d3-818b-0aadf03e0709 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:52 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-c6dc2c25-b8d5-45d3-818b-0aadf03e0709 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Deleted volume successfully. Feb 27 02:05:52 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c6dc2c25-b8d5-45d3-818b-0aadf03e0709 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069793309 None] Lock "cinder-19637c81-ff91-416a-a66f-32089592f5e4-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:52 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf 1073741824" returned: 0 in 0.726s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:52 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=114,cinder:INSERT=31,cinder:UPDATE=121,cinder:DELETE=8 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:05:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:52 devstack sudo[85934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf Feb 27 02:05:52 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:53 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf" returned: 0 in 0.544s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8604b64a-9948-4c86-8ebf-ede57e0d9509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b78e302-717b-4cc4-889b-24c0bdbc7faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:53 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Volume volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf (69f3a557-9c92-4ee6-8636-db3efd7bacaf): created successfully Feb 27 02:05:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b78e302-717b-4cc4-889b-24c0bdbc7faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Flow 'volume_create_manager' (a41b3eb9-5f5c-477e-a030-514c63be65de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:53 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-87b7faf3-3909-4b09-a5c0-bae8450a8b18 tempest-VolumesDeleteCascade-637113945 None] Created volume successfully. Feb 27 02:05:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6c06b657-cfb6-4445-ac14-e1be1b1740a2 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6c06b657-cfb6-4445-ac14-e1be1b1740a2 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-6c06b657-cfb6-4445-ac14-e1be1b1740a2 tempest-VolumesDeleteCascade-637113945 None] Creating offline snapshot 522f286c-6291-4ae2-a36d-ed1a82b35e8c of volume 69f3a557-9c92-4ee6-8636-db3efd7bacaf {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:05:54 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[da95a858-be10-4e58-86c2-cd94736ea398]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6c06b657-cfb6-4445-ac14-e1be1b1740a2 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:54 devstack sudo[85964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf Feb 27 02:05:54 devstack sudo[85964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:55 devstack sudo[85964]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6c06b657-cfb6-4445-ac14-e1be1b1740a2 tempest-VolumesDeleteCascade-637113945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf" returned: 0 in 1.111s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6c06b657-cfb6-4445-ac14-e1be1b1740a2 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:55 devstack sudo[85970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c 1G Feb 27 02:05:55 devstack sudo[85970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:56 devstack sudo[85970]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6c06b657-cfb6-4445-ac14-e1be1b1740a2 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c 1G" returned: 0 in 0.753s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6c06b657-cfb6-4445-ac14-e1be1b1740a2 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:56 devstack sudo[85999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c Feb 27 02:05:56 devstack sudo[85999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:57 devstack sudo[85999]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6c06b657-cfb6-4445-ac14-e1be1b1740a2 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c" returned: 0 in 0.659s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:57 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-6c06b657-cfb6-4445-ac14-e1be1b1740a2 tempest-VolumesDeleteCascade-637113945 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c is being set with open permissions: ugo+rw Feb 27 02:05:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6c06b657-cfb6-4445-ac14-e1be1b1740a2 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:57 devstack sudo[86004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c Feb 27 02:05:57 devstack sudo[86004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:57 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Flow 'volume_create_manager' (79de3bc8-4877-4e15-9151-b7251a59bd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99f8ecc-d1c2-479d-91ee-c88b8dac6b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99f8ecc-d1c2-479d-91ee-c88b8dac6b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1516067861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac47691-a571-4f21-aea5-c24cb7dadf7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14eaa48a14e848bf9f1cfb68cf3d1e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:57Z,use_quota=True,user_id='77f3ff52a54b4865b50a4eb5914803fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5da7cd-dde8-47a2-84da-f1d9805690af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5da7cd-dde8-47a2-84da-f1d9805690af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a659dabd-767c-45af-a15f-ae640a466df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a659dabd-767c-45af-a15f-ae640a466df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ac47691-a571-4f21-aea5-c24cb7dadf7d', 'volume_name': 'volume-6ac47691-a571-4f21-aea5-c24cb7dadf7d', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e429df69-4f70-4c3c-8c72-24eb02556735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e429df69-4f70-4c3c-8c72-24eb02556735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e845d090-a02e-4b75-891c-0ed2f382ef04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:57 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Volume 6ac47691-a571-4f21-aea5-c24cb7dadf7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ac47691-a571-4f21-aea5-c24cb7dadf7d', 'volume_size': 1} Feb 27 02:05:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:57 devstack sudo[86004]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6c06b657-cfb6-4445-ac14-e1be1b1740a2 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c" returned: 0 in 0.630s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6c06b657-cfb6-4445-ac14-e1be1b1740a2 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:57 devstack sudo[86007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.info Feb 27 02:05:57 devstack sudo[86007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:58 devstack sudo[86007]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6c06b657-cfb6-4445-ac14-e1be1b1740a2 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.info" returned: 0 in 0.546s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:58 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-6c06b657-cfb6-4445-ac14-e1be1b1740a2 tempest-VolumesDeleteCascade-637113945 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.info is being set with open permissions: ugo+rw Feb 27 02:05:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6c06b657-cfb6-4445-ac14-e1be1b1740a2 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:58 devstack sudo[86010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.info Feb 27 02:05:58 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:58 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6c06b657-cfb6-4445-ac14-e1be1b1740a2 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.info" returned: 0 in 0.640s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6c06b657-cfb6-4445-ac14-e1be1b1740a2 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.428s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.726s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:58 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1516067861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac47691-a571-4f21-aea5-c24cb7dadf7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14eaa48a14e848bf9f1cfb68cf3d1e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:57Z,use_quota=True,user_id='77f3ff52a54b4865b50a4eb5914803fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:58 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Creating volume 6ac47691-a571-4f21-aea5-c24cb7dadf7d {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:58 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:58 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:58 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:58 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:05:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ac47691-a571-4f21-aea5-c24cb7dadf7d 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:58 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-6c06b657-cfb6-4445-ac14-e1be1b1740a2 tempest-VolumesDeleteCascade-637113945 None] Create snapshot completed successfully Feb 27 02:05:58 devstack sudo[86034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ac47691-a571-4f21-aea5-c24cb7dadf7d 1073741824 Feb 27 02:05:58 devstack sudo[86034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:59 devstack sudo[86034]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ac47691-a571-4f21-aea5-c24cb7dadf7d 1073741824" returned: 0 in 0.887s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ac47691-a571-4f21-aea5-c24cb7dadf7d {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:59 devstack sudo[86062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ac47691-a571-4f21-aea5-c24cb7dadf7d Feb 27 02:05:59 devstack sudo[86062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Flow 'volume_create_manager' (73e062d9-9f6a-46a3-b18d-fff0204455bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e77fa7b-a399-429f-999d-6d170b4a7ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e77fa7b-a399-429f-999d-6d170b4a7ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1752296252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522a472b5bea4a6e94b10f6640168b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=522f286c-6291-4ae2-a36d-ed1a82b35e8c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:00Z,use_quota=True,user_id='6602d2357d7e4294be4d74bf1021679d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e394db6-705e-49c1-8f78-4bc7b19b6db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e394db6-705e-49c1-8f78-4bc7b19b6db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:00 devstack sudo[86062]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721c0aaf-e00a-47d5-8add-861b2e1d66e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721c0aaf-e00a-47d5-8add-861b2e1d66e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46', 'volume_name': 'volume-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46', 'volume_size': 1, 'snapshot_id': '522f286c-6291-4ae2-a36d-ed1a82b35e8c'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f161414a-aac6-40ac-b48c-3ee8b39eadec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f161414a-aac6-40ac-b48c-3ee8b39eadec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027b1c7d-473c-4fc3-a431-48990f19f01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:00 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Volume 0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46', 'volume_size': 1, 'snapshot_id': '522f286c-6291-4ae2-a36d-ed1a82b35e8c'} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ac47691-a571-4f21-aea5-c24cb7dadf7d" returned: 0 in 0.651s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e845d090-a02e-4b75-891c-0ed2f382ef04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac47691-a571-4f21-aea5-c24cb7dadf7d', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b1471c4-095b-4809-8a84-50968282b87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "cinder-quobyte-522f286c-6291-4ae2-a36d-ed1a82b35e8c-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46" by "_create_volume_from_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:00 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Volume volume-6ac47691-a571-4f21-aea5-c24cb7dadf7d (6ac47691-a571-4f21-aea5-c24cb7dadf7d): created successfully Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b1471c4-095b-4809-8a84-50968282b87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Flow 'volume_create_manager' (79de3bc8-4877-4e15-9151-b7251a59bd5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-522f286c-6291-4ae2-a36d-ed1a82b35e8c-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Creating volume 0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46 from snapshot 522f286c-6291-4ae2-a36d-ed1a82b35e8c {{(pid=82738) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "cinder-quobyte-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46" by "_copy_volume_from_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:00 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-804f820a-8d9f-4690-bbcc-f69735d12ac9 tempest-VolumesTransfersTest-1907008596 None] Created volume successfully. Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] snapshot: 522f286c-6291-4ae2-a36d-ed1a82b35e8c, volume: 0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46, {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5255725-2476-48ad-8f34-df9e72d7ca54]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:00 devstack sudo[86067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c Feb 27 02:06:00 devstack sudo[86067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:01 devstack sudo[86067]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c" returned: 0 in 0.786s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:06:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Creating direct copy from snapshot {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:06:01 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b765a24-5f85-4198-8ebd-e7c1ffcf2cf7]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:01 devstack sudo[86072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf Feb 27 02:06:01 devstack sudo[86072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:02 devstack sudo[86072]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf" returned: 0 in 0.753s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:02 devstack cinder-volume[82738]: DEBUG cinder.utils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Path /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46 not found in is_blk_device check {{(pid=82738) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:06:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:02 devstack sudo[86077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46 Feb 27 02:06:02 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:02 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=85,cinder:UPDATE=115,cinder:DELETE=12,cinder:INSERT=27 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:06:02 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-34250411-16ae-4407-8f43-f64e2496b7ba tempest-VolumesTransfersTest-470578305 None] Transfer volume completed successfully. Feb 27 02:06:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4670ea0d-d15d-4de5-aa17-234b6b5a9968 tempest-VolumesTransfersTest-112080695 None] Acquiring lock "cinder-6ac47691-a571-4f21-aea5-c24cb7dadf7d-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4670ea0d-d15d-4de5-aa17-234b6b5a9968 tempest-VolumesTransfersTest-112080695 None] Lock "cinder-6ac47691-a571-4f21-aea5-c24cb7dadf7d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4670ea0d-d15d-4de5-aa17-234b6b5a9968 tempest-VolumesTransfersTest-112080695 None] Acquiring lock "cinder-quobyte-6ac47691-a571-4f21-aea5-c24cb7dadf7d" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4670ea0d-d15d-4de5-aa17-234b6b5a9968 tempest-VolumesTransfersTest-112080695 None] Lock "cinder-quobyte-6ac47691-a571-4f21-aea5-c24cb7dadf7d" acquired by "delete_volume" :: waited 0.025s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:04 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f0759f-71e6-422b-946b-c0e8046232cc]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4670ea0d-d15d-4de5-aa17-234b6b5a9968 tempest-VolumesTransfersTest-112080695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ac47691-a571-4f21-aea5-c24cb7dadf7d {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:05 devstack sudo[86092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ac47691-a571-4f21-aea5-c24cb7dadf7d Feb 27 02:06:05 devstack sudo[86092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:05 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46" returned: 0 in 3.360s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:05 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b67dc36-31cf-4a20-aa6b-48d8adf0e335]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:05 devstack sudo[86098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf Feb 27 02:06:05 devstack sudo[86098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:05 devstack sudo[86092]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4670ea0d-d15d-4de5-aa17-234b6b5a9968 tempest-VolumesTransfersTest-112080695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ac47691-a571-4f21-aea5-c24cb7dadf7d" returned: 0 in 1.050s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4670ea0d-d15d-4de5-aa17-234b6b5a9968 tempest-VolumesTransfersTest-112080695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ac47691-a571-4f21-aea5-c24cb7dadf7d {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:05 devstack sudo[86106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ac47691-a571-4f21-aea5-c24cb7dadf7d Feb 27 02:06:05 devstack sudo[86106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:06 devstack sudo[86098]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf" returned: 0 in 0.976s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:06 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf, size 1024.00 MB, duration 3.36 sec, destination /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46 {{(pid=82738) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:06:06 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Converted 1024.00 MB image at 304.68 MB/s Feb 27 02:06:06 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46 is being set with open permissions: ugo+rw Feb 27 02:06:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:06 devstack sudo[86112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46 Feb 27 02:06:06 devstack sudo[86112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:06 devstack sudo[86106]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4670ea0d-d15d-4de5-aa17-234b6b5a9968 tempest-VolumesTransfersTest-112080695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6ac47691-a571-4f21-aea5-c24cb7dadf7d" returned: 0 in 0.566s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:06 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4670ea0d-d15d-4de5-aa17-234b6b5a9968 tempest-VolumesTransfersTest-112080695 None] Lock "cinder-quobyte-6ac47691-a571-4f21-aea5-c24cb7dadf7d" released by "delete_volume" :: held 1.678s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:06 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-4670ea0d-d15d-4de5-aa17-234b6b5a9968 tempest-VolumesTransfersTest-112080695 None] Created reservations ['7c4ecbbe-fe88-42d7-ac2e-73edce5cd86a', 'ed3b51c3-417f-4a50-a492-bf0c70ecfc58', '41d804b9-84f9-4b67-a881-85504b0b9114', 'b63e7681-c12d-4438-b849-ceb7d9bcdca5'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4670ea0d-d15d-4de5-aa17-234b6b5a9968 tempest-VolumesTransfersTest-112080695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4670ea0d-d15d-4de5-aa17-234b6b5a9968 tempest-VolumesTransfersTest-112080695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:06 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-4670ea0d-d15d-4de5-aa17-234b6b5a9968 tempest-VolumesTransfersTest-112080695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:06 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-4670ea0d-d15d-4de5-aa17-234b6b5a9968 tempest-VolumesTransfersTest-112080695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4670ea0d-d15d-4de5-aa17-234b6b5a9968 tempest-VolumesTransfersTest-112080695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4670ea0d-d15d-4de5-aa17-234b6b5a9968 tempest-VolumesTransfersTest-112080695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:06 devstack sudo[86114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:06:06 devstack sudo[86114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:06 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Flow 'volume_create_manager' (50021e83-c719-4158-ad19-51698f8a1430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3accce3-d893-440d-a47f-6612d9519d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3accce3-d893-440d-a47f-6612d9519d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-369828794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c28d8dad294d2ca780170c6f454e58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:07Z,use_quota=True,user_id='a148e478fbe54e59b34b2d45b5b2d420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:07 devstack sudo[86112]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e847fcce-13e0-4cf2-a53f-1386c47bd413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e847fcce-13e0-4cf2-a53f-1386c47bd413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9b4e2b-e785-47f3-9adf-1f0afa078525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.image.glance [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Creating Keystone auth plugin from conf {{(pid=82738) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46" returned: 0 in 0.626s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46" released by "_copy_volume_from_snapshot" :: held 6.591s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-522f286c-6291-4ae2-a36d-ed1a82b35e8c-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46" released by "_create_volume_from_snapshot" :: held 6.624s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.650s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027b1c7d-473c-4fc3-a431-48990f19f01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46', 'volume_size': 1, 'snapshot_id': '522f286c-6291-4ae2-a36d-ed1a82b35e8c'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d41221f0-db39-4cfd-a11a-4f6970a6ae96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:07 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Volume volume-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46 (0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46): created successfully Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d41221f0-db39-4cfd-a11a-4f6970a6ae96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Flow 'volume_create_manager' (73e062d9-9f6a-46a3-b18d-fff0204455bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:07 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e8d96e4c-e11c-43cf-a0ae-b90168c3fd07 tempest-VolumesDeleteCascade-637113945 None] Created volume successfully. Feb 27 02:06:07 devstack sudo[86114]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4670ea0d-d15d-4de5-aa17-234b6b5a9968 tempest-VolumesTransfersTest-112080695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.554s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-4670ea0d-d15d-4de5-aa17-234b6b5a9968 tempest-VolumesTransfersTest-112080695 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:07 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-4670ea0d-d15d-4de5-aa17-234b6b5a9968 tempest-VolumesTransfersTest-112080695 None] Deleted volume successfully. Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4670ea0d-d15d-4de5-aa17-234b6b5a9968 tempest-VolumesTransfersTest-112080695 None] Lock "cinder-6ac47691-a571-4f21-aea5-c24cb7dadf7d-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9b4e2b-e785-47f3-9adf-1f0afa078525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8', 'volume_name': 'volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8', 'volume_size': 1, 'image_id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db1770ccb718417cb73a54677fa92116', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'created_at': datetime.datetime(2026, 2, 27, 0, 57, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b706c9e-6966-424a-b9ee-45ddbab3a331/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a091a48f-5b2d-4c15-84ea-438fcbf215bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a091a48f-5b2d-4c15-84ea-438fcbf215bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d664c6-8a8f-4129-b655-3d1f64c3abe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:07 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Volume 7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8', 'volume_size': 1, 'image_id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db1770ccb718417cb73a54677fa92116', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'created_at': datetime.datetime(2026, 2, 27, 0, 57, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b706c9e-6966-424a-b9ee-45ddbab3a331/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Trying to clone 7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 from image 4b706c9e-6966-424a-b9ee-45ddbab3a331 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}]). {{(pid=82738) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Flow 'volume_create_manager' (d0e157f6-df12-49c1-af26-e287fd0e7ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55adcfb7-79eb-4599-b11e-fe1965a2c70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55adcfb7-79eb-4599-b11e-fe1965a2c70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1012409049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=659bfb07-bfb7-4c65-a77e-15aaa47550a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14eaa48a14e848bf9f1cfb68cf3d1e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:07Z,use_quota=True,user_id='77f3ff52a54b4865b50a4eb5914803fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7425337a-d27a-4e20-afa3-8e34333bcf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7425337a-d27a-4e20-afa3-8e34333bcf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337fd836-56f5-4190-9291-7ab0399a2b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337fd836-56f5-4190-9291-7ab0399a2b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '659bfb07-bfb7-4c65-a77e-15aaa47550a1', 'volume_name': 'volume-659bfb07-bfb7-4c65-a77e-15aaa47550a1', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f0b16a-2ff0-44b5-b361-a0f879252a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f0b16a-2ff0-44b5-b361-a0f879252a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62f48d0-c3cd-4b2f-bf75-f2701a10a0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:07 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Volume 659bfb07-bfb7-4c65-a77e-15aaa47550a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-659bfb07-bfb7-4c65-a77e-15aaa47550a1', 'volume_size': 1} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1012409049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=659bfb07-bfb7-4c65-a77e-15aaa47550a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14eaa48a14e848bf9f1cfb68cf3d1e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:07Z,use_quota=True,user_id='77f3ff52a54b4865b50a4eb5914803fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Creating volume 659bfb07-bfb7-4c65-a77e-15aaa47550a1 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:07 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-659bfb07-bfb7-4c65-a77e-15aaa47550a1 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:07 devstack sudo[86138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-659bfb07-bfb7-4c65-a77e-15aaa47550a1 1073741824 Feb 27 02:06:07 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_jhmwabksdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82738) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 02:06:07 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Image download 20.69 MB at 20.69 MB/s Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f97326-b292-486b-ab4c-6fe815f74058]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_jhmwabksdevstack@QuobyteHD {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:07 devstack sudo[86141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_jhmwabksdevstack@QuobyteHD Feb 27 02:06:07 devstack sudo[86141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "cinder-69f3a557-9c92-4ee6-8636-db3efd7bacaf-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-69f3a557-9c92-4ee6-8636-db3efd7bacaf-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:08 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Performing cascade delete. {{(pid=82738) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 27 02:06:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "cinder-522f286c-6291-4ae2-a36d-ed1a82b35e8c-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-522f286c-6291-4ae2-a36d-ed1a82b35e8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "cinder-quobyte-69f3a557-9c92-4ee6-8636-db3efd7bacaf" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-69f3a557-9c92-4ee6-8636-db3efd7bacaf" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "cinder-quobyte-522f286c-6291-4ae2-a36d-ed1a82b35e8c" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:08 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-522f286c-6291-4ae2-a36d-ed1a82b35e8c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Deleting offline snapshot 522f286c-6291-4ae2-a36d-ed1a82b35e8c of volume 69f3a557-9c92-4ee6-8636-db3efd7bacaf {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:06:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] snapshot_file for this snap is: volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:06:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-659bfb07-bfb7-4c65-a77e-15aaa47550a1 1073741824" returned: 0 in 0.877s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:08 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[453705d5-22b7-4fa7-b7f6-ef3ef4820090]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:08 devstack sudo[86141]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_jhmwabksdevstack@QuobyteHD" returned: 0 in 0.712s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:08 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Temporary image 4b706c9e-6966-424a-b9ee-45ddbab3a331 is fetched for user a148e478fbe54e59b34b2d45b5b2d420. {{(pid=82738) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 02:06:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-659bfb07-bfb7-4c65-a77e-15aaa47550a1 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:08 devstack sudo[86152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-659bfb07-bfb7-4c65-a77e-15aaa47550a1 Feb 27 02:06:08 devstack sudo[86152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:08 devstack sudo[86151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c Feb 27 02:06:08 devstack sudo[86151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:08 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ae64d7-caa3-4c67-a2f7-40f9e663f526]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_jhmwabksdevstack@QuobyteHD {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:08 devstack sudo[86155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_jhmwabksdevstack@QuobyteHD Feb 27 02:06:08 devstack sudo[86155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:09 devstack sudo[86152]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-659bfb07-bfb7-4c65-a77e-15aaa47550a1" returned: 0 in 0.769s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62f48d0-c3cd-4b2f-bf75-f2701a10a0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-659bfb07-bfb7-4c65-a77e-15aaa47550a1', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bdda959-8347-4ef5-8535-5e934c9e0a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:09 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Volume volume-659bfb07-bfb7-4c65-a77e-15aaa47550a1 (659bfb07-bfb7-4c65-a77e-15aaa47550a1): created successfully Feb 27 02:06:09 devstack sudo[86151]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bdda959-8347-4ef5-8535-5e934c9e0a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Flow 'volume_create_manager' (d0e157f6-df12-49c1-af26-e287fd0e7ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c" returned: 0 in 0.894s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:09 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-3d1ea757-dc61-4f53-bdba-86d495ec46e1 tempest-VolumesTransfersTest-1907008596 None] Created volume successfully. Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe445b6-c069-4ac8-b2e2-7055ee7d5429]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:09 devstack sudo[86155]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_jhmwabksdevstack@QuobyteHD" returned: 0 in 0.737s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-369828794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c28d8dad294d2ca780170c6f454e58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:07Z,use_quota=True,user_id='a148e478fbe54e59b34b2d45b5b2d420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Creating volume 7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:09 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:09 devstack sudo[86165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 1073741824 Feb 27 02:06:09 devstack sudo[86165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:09 devstack sudo[86164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf Feb 27 02:06:09 devstack sudo[86164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-501298fc-9d2a-4375-8126-607ed28c9c1b tempest-VolumesTransfersTest-112080695 None] Acquiring lock "cinder-659bfb07-bfb7-4c65-a77e-15aaa47550a1-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:09 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-501298fc-9d2a-4375-8126-607ed28c9c1b tempest-VolumesTransfersTest-112080695 None] Lock "cinder-659bfb07-bfb7-4c65-a77e-15aaa47550a1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:10 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-501298fc-9d2a-4375-8126-607ed28c9c1b tempest-VolumesTransfersTest-112080695 None] Acquiring lock "cinder-quobyte-659bfb07-bfb7-4c65-a77e-15aaa47550a1" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:10 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-501298fc-9d2a-4375-8126-607ed28c9c1b tempest-VolumesTransfersTest-112080695 None] Lock "cinder-quobyte-659bfb07-bfb7-4c65-a77e-15aaa47550a1" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:10 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21fee79-aee8-4092-98eb-31f6ff86e475]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-501298fc-9d2a-4375-8126-607ed28c9c1b tempest-VolumesTransfersTest-112080695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-659bfb07-bfb7-4c65-a77e-15aaa47550a1 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:10 devstack sudo[86185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-659bfb07-bfb7-4c65-a77e-15aaa47550a1 Feb 27 02:06:10 devstack sudo[86185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:10 devstack sudo[86165]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 1073741824" returned: 0 in 0.722s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:10 devstack sudo[86192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 Feb 27 02:06:10 devstack sudo[86192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:10 devstack sudo[86164]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf" returned: 0 in 0.887s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:10 devstack sudo[86194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c Feb 27 02:06:10 devstack sudo[86194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:10 devstack sudo[86185]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-501298fc-9d2a-4375-8126-607ed28c9c1b tempest-VolumesTransfersTest-112080695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-659bfb07-bfb7-4c65-a77e-15aaa47550a1" returned: 0 in 0.639s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-501298fc-9d2a-4375-8126-607ed28c9c1b tempest-VolumesTransfersTest-112080695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-659bfb07-bfb7-4c65-a77e-15aaa47550a1 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:10 devstack sudo[86201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-659bfb07-bfb7-4c65-a77e-15aaa47550a1 Feb 27 02:06:10 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:10 devstack sudo[86192]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8" returned: 0 in 0.549s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:10 devstack cinder-volume[82738]: DEBUG cinder.volume.volume_utils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Attempting download of 4b706c9e-6966-424a-b9ee-45ddbab3a331 ((None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}])) to volume 7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8. {{(pid=82738) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 02:06:10 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e311e1-feb5-4286-b8ed-11ff4d8ce752]: (4, 'raw') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_sb1sunq_ {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:10 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_sb1sunq_ Feb 27 02:06:10 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:10 devstack sudo[86194]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c" returned: 0 in 0.679s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:10 devstack sudo[86208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c Feb 27 02:06:10 devstack sudo[86208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:11 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-501298fc-9d2a-4375-8126-607ed28c9c1b tempest-VolumesTransfersTest-112080695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-659bfb07-bfb7-4c65-a77e-15aaa47550a1" returned: 0 in 0.556s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-501298fc-9d2a-4375-8126-607ed28c9c1b tempest-VolumesTransfersTest-112080695 None] Lock "cinder-quobyte-659bfb07-bfb7-4c65-a77e-15aaa47550a1" released by "delete_volume" :: held 1.222s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-501298fc-9d2a-4375-8126-607ed28c9c1b tempest-VolumesTransfersTest-112080695 None] Created reservations ['4de1cbbd-37ac-48fd-ae2d-f26441c845ac', 'feefc062-0ff8-4af1-b0ed-a08bc8b027d4', '35b27a6d-10f4-4af8-9c43-156a44e642eb', '493ee298-015a-438f-ba88-a1302d4b1b59'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-501298fc-9d2a-4375-8126-607ed28c9c1b tempest-VolumesTransfersTest-112080695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-501298fc-9d2a-4375-8126-607ed28c9c1b tempest-VolumesTransfersTest-112080695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-501298fc-9d2a-4375-8126-607ed28c9c1b tempest-VolumesTransfersTest-112080695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-501298fc-9d2a-4375-8126-607ed28c9c1b tempest-VolumesTransfersTest-112080695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-501298fc-9d2a-4375-8126-607ed28c9c1b tempest-VolumesTransfersTest-112080695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-501298fc-9d2a-4375-8126-607ed28c9c1b tempest-VolumesTransfersTest-112080695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:11 devstack sudo[86214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:06:11 devstack sudo[86214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:11 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_sb1sunq_" returned: 0 in 0.561s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_sb1sunq_ {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:11 devstack sudo[86208]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf.522f286c-6291-4ae2-a36d-ed1a82b35e8c" returned: 0 in 0.489s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-522f286c-6291-4ae2-a36d-ed1a82b35e8c" released by "_delete_snapshot" :: held 3.025s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-69f3a557-9c92-4ee6-8636-db3efd7bacaf" released by "delete_snapshot" :: held 3.045s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Created reservations ['ab012cb5-c29b-4d24-b444-f81210e10d92', '2c580aa2-f73d-4fae-bab3-9bcf2b0c9e2d', '08a5bbf6-c801-4e3b-9506-afcc17c439a1', 'cae9701d-614a-42fd-b85c-8c8d86df457c'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:11 devstack sudo[86216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_sb1sunq_ Feb 27 02:06:11 devstack sudo[86216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:11 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Delete snapshot completed successfully. Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-522f286c-6291-4ae2-a36d-ed1a82b35e8c-delete_snapshot" released by "delete_snapshot" :: held 3.197s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Snapshots deleted, issuing volume delete {{(pid=82738) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "cinder-quobyte-69f3a557-9c92-4ee6-8636-db3efd7bacaf" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-69f3a557-9c92-4ee6-8636-db3efd7bacaf" acquired by "delete_volume" :: waited 0.017s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3bb9d9-4f6b-4dd1-ae1f-b6518ba2d9d0]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:11 devstack sudo[86218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf Feb 27 02:06:11 devstack sudo[86218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:11 devstack sudo[86214]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-501298fc-9d2a-4375-8126-607ed28c9c1b tempest-VolumesTransfersTest-112080695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.535s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-501298fc-9d2a-4375-8126-607ed28c9c1b tempest-VolumesTransfersTest-112080695 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:11 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-501298fc-9d2a-4375-8126-607ed28c9c1b tempest-VolumesTransfersTest-112080695 None] Deleted volume successfully. Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-501298fc-9d2a-4375-8126-607ed28c9c1b tempest-VolumesTransfersTest-112080695 None] Lock "cinder-659bfb07-bfb7-4c65-a77e-15aaa47550a1-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:11 devstack sudo[86216]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_sb1sunq_" returned: 1 in 0.592s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_sb1sunq_' failed. Not Retrying. {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[69637375-da6e-48d3-acd7-8fbdf35061bb]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_jhmwabksdevstack@QuobyteHD {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:12 devstack sudo[86223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_jhmwabksdevstack@QuobyteHD Feb 27 02:06:12 devstack sudo[86223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:12 devstack sudo[86218]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf" returned: 0 in 0.586s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:12 devstack sudo[86228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf Feb 27 02:06:12 devstack sudo[86228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:12 devstack sudo[86223]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_jhmwabksdevstack@QuobyteHD" returned: 0 in 0.621s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:12 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] 4b706c9e-6966-424a-b9ee-45ddbab3a331 was qcow2, converting to raw {{(pid=82738) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 02:06:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_jhmwabksdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:12 devstack sudo[86233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_jhmwabksdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 Feb 27 02:06:12 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:12 devstack sudo[86228]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-69f3a557-9c92-4ee6-8636-db3efd7bacaf" returned: 0 in 0.580s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:12 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-69f3a557-9c92-4ee6-8636-db3efd7bacaf" released by "delete_volume" :: held 1.213s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:12 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Created reservations ['2a914dda-ef37-4b69-992a-740ae8883269', '7add9dfb-0f02-401d-8f2c-9fb4da4c7daf', '0bbf6745-d8b6-4df3-b720-6b6121423aa6', '8506b850-eaf5-495a-91a9-f8be1817ff43'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:12 devstack sudo[86237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:06:12 devstack sudo[86237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:13 devstack sudo[86237]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.636s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:13 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:13 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Deleted volume successfully. Feb 27 02:06:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8d6302d0-e178-4d55-b25a-8fc55818ab63 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-69f3a557-9c92-4ee6-8636-db3efd7bacaf-delete_volume" released by "delete_volume" :: held 5.256s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d152d308-5138-449d-9251-5fae450fd0e1 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "cinder-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d152d308-5138-449d-9251-5fae450fd0e1 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:14 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d152d308-5138-449d-9251-5fae450fd0e1 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "cinder-quobyte-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:14 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d152d308-5138-449d-9251-5fae450fd0e1 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46" acquired by "delete_volume" :: waited 0.024s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:14 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d45e8aa-3c0f-4bc2-a791-8d122636bfdb]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d152d308-5138-449d-9251-5fae450fd0e1 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:14 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_jhmwabksdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8" returned: 0 in 1.459s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:14 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_jhmwabksdevstack@QuobyteHD, size 112.00 MB, duration 1.46 sec, destination /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 {{(pid=82738) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:06:14 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Converted 112.00 MB image at 76.71 MB/s Feb 27 02:06:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:14 devstack sudo[86258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 1G Feb 27 02:06:14 devstack sudo[86258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:14 devstack sudo[86257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46 Feb 27 02:06:14 devstack sudo[86257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:14 devstack sudo[86257]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d152d308-5138-449d-9251-5fae450fd0e1 tempest-VolumesDeleteCascade-637113945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46" returned: 0 in 0.733s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:14 devstack sudo[86258]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d152d308-5138-449d-9251-5fae450fd0e1 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 1G" returned: 0 in 0.715s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:14 devstack sudo[86292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46 Feb 27 02:06:14 devstack sudo[86292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:14 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b29212-6f4c-47af-a9d1-6dc78dd35d1a]: (4, 'raw') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:15 devstack sudo[86295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 Feb 27 02:06:15 devstack sudo[86295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:15 devstack sudo[86292]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d152d308-5138-449d-9251-5fae450fd0e1 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46" returned: 0 in 1.063s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d152d308-5138-449d-9251-5fae450fd0e1 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-quobyte-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46" released by "delete_volume" :: held 1.844s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:15 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-d152d308-5138-449d-9251-5fae450fd0e1 tempest-VolumesDeleteCascade-637113945 None] Created reservations ['9c6e2072-53b7-493e-a713-01f21d04c651', '3fcab818-11a8-407a-9fbc-bb81ff556795', '8158a529-6008-4011-86d3-e164e0d944a7', 'f7ff755e-dde9-4483-a571-da9ef402c832'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d152d308-5138-449d-9251-5fae450fd0e1 tempest-VolumesDeleteCascade-637113945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d152d308-5138-449d-9251-5fae450fd0e1 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d152d308-5138-449d-9251-5fae450fd0e1 tempest-VolumesDeleteCascade-637113945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d152d308-5138-449d-9251-5fae450fd0e1 tempest-VolumesDeleteCascade-637113945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d152d308-5138-449d-9251-5fae450fd0e1 tempest-VolumesDeleteCascade-637113945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d152d308-5138-449d-9251-5fae450fd0e1 tempest-VolumesDeleteCascade-637113945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:16 devstack sudo[86307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:06:16 devstack sudo[86307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:16 devstack sudo[86295]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8" returned: 0 in 1.222s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:16 devstack sudo[86309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 Feb 27 02:06:16 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:17 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8" returned: 1 in 0.941s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8' failed. Not Retrying. {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:06:17 devstack cinder-volume[82738]: DEBUG cinder.volume.volume_utils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Downloaded image 4b706c9e-6966-424a-b9ee-45ddbab3a331 ((None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}])) to volume 7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 successfully. {{(pid=82738) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 02:06:17 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Temporary image 4b706c9e-6966-424a-b9ee-45ddbab3a331 for user a148e478fbe54e59b34b2d45b5b2d420 is deleted. {{(pid=82738) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 02:06:17 devstack cinder-volume[82738]: DEBUG cinder.volume.volume_utils [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Marking volume 7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 as bootable. {{(pid=82738) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 02:06:17 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Copying metadata from image 4b706c9e-6966-424a-b9ee-45ddbab3a331 to 7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8. {{(pid=82738) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 02:06:17 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Creating volume glance metadata for volume 7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 backed by image 4b706c9e-6966-424a-b9ee-45ddbab3a331 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82738) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 02:06:17 devstack sudo[86307]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d152d308-5138-449d-9251-5fae450fd0e1 tempest-VolumesDeleteCascade-637113945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 1.194s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:17 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-d152d308-5138-449d-9251-5fae450fd0e1 tempest-VolumesDeleteCascade-637113945 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:17 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-d152d308-5138-449d-9251-5fae450fd0e1 tempest-VolumesDeleteCascade-637113945 None] Deleted volume successfully. Feb 27 02:06:17 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d664c6-8a8f-4129-b655-3d1f64c3abe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8', 'volume_size': 1, 'image_id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db1770ccb718417cb73a54677fa92116', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'created_at': datetime.datetime(2026, 2, 27, 0, 57, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b706c9e-6966-424a-b9ee-45ddbab3a331/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:17 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8793e88b-04a6-4261-af81-3724cdf140e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:17 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d152d308-5138-449d-9251-5fae450fd0e1 tempest-VolumesDeleteCascade-637113945 None] Lock "cinder-0828e71d-e8e0-468f-9a4e-2ba7cbe2ef46-delete_volume" released by "delete_volume" :: held 3.295s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:17 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Volume volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 (7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8): created successfully Feb 27 02:06:17 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8793e88b-04a6-4261-af81-3724cdf140e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:17 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Flow 'volume_create_manager' (50021e83-c719-4158-ad19-51698f8a1430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:17 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-ad08554c-70c4-4268-9ab1-cc23f5cdd2ac tempest-VolumesImageMetadata-562325724 None] Created volume successfully. Feb 27 02:06:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] Acquiring lock "cinder-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] Lock "cinder-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] Acquiring lock "cinder-quobyte-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] Lock "cinder-quobyte-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8" acquired by "delete_volume" :: waited 0.047s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:18 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[46787b9f-45b0-4157-818a-1d35ff4ed0ad]: (4, 'raw') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:18 devstack sudo[86350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 Feb 27 02:06:18 devstack sudo[86350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:19 devstack sudo[86350]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8" returned: 0 in 0.625s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:19 devstack sudo[86354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 Feb 27 02:06:19 devstack sudo[86354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:19 devstack sudo[86354]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8" returned: 1 in 0.621s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8' failed. Not Retrying. {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:06:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:19 devstack sudo[86359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8 Feb 27 02:06:19 devstack sudo[86359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Flow 'volume_create_manager' (ab73c1e2-77b8-462a-98dc-0facc91967ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6474557-de82-44bf-86a5-d10882219477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6474557-de82-44bf-86a5-d10882219477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1951227842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08857a5-d008-4456-a535-cf0455e0f6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a6914b5b794e968dec82e16f4d610e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:20Z,use_quota=True,user_id='8ad05e4c5fc44f7a919b58d60c4c27c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1065179-03ec-4a87-908f-af38c176deb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1065179-03ec-4a87-908f-af38c176deb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b8000b-324a-4372-b48c-f0256e471d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b8000b-324a-4372-b48c-f0256e471d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a08857a5-d008-4456-a535-cf0455e0f6fe', 'volume_name': 'volume-a08857a5-d008-4456-a535-cf0455e0f6fe', 'volume_size': 2}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9aede18-c6e1-48cd-97cc-11e4b0e1411e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9aede18-c6e1-48cd-97cc-11e4b0e1411e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c4098d-0d95-46ea-8a3e-23b120791254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:20 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Volume a08857a5-d008-4456-a535-cf0455e0f6fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a08857a5-d008-4456-a535-cf0455e0f6fe', 'volume_size': 2} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1951227842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08857a5-d008-4456-a535-cf0455e0f6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a6914b5b794e968dec82e16f4d610e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:20Z,use_quota=True,user_id='8ad05e4c5fc44f7a919b58d60c4c27c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Creating volume a08857a5-d008-4456-a535-cf0455e0f6fe {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:20 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a08857a5-d008-4456-a535-cf0455e0f6fe 2147483648 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:20 devstack sudo[86359]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:20 devstack sudo[86362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a08857a5-d008-4456-a535-cf0455e0f6fe 2147483648 Feb 27 02:06:20 devstack sudo[86362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8" returned: 0 in 0.553s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] Lock "cinder-quobyte-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8" released by "delete_volume" :: held 1.888s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Flow 'volume_create_manager' (d5c2fba0-2dcf-45c1-ba9a-94f52bd671d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f589f1e-1d59-4406-a6d0-de4f2ed56e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f589f1e-1d59-4406-a6d0-de4f2ed56e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-693996489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57d01e7-4b16-4196-af70-69372a603295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94a8ef129b194740b0cf6daa5f2b5eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:20Z,use_quota=True,user_id='27b3d923d7154a2587a28ad7132c5487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c1177e-a20e-45f3-a7e3-b4c2b99e7580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c1177e-a20e-45f3-a7e3-b4c2b99e7580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db7eef2-365a-4d63-9be1-398909e67d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db7eef2-365a-4d63-9be1-398909e67d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c57d01e7-4b16-4196-af70-69372a603295', 'volume_name': 'volume-c57d01e7-4b16-4196-af70-69372a603295', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2f4b94-45de-4a96-bdbe-17acedbf7ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2f4b94-45de-4a96-bdbe-17acedbf7ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2927e795-da9b-415f-9161-4f250f8d6f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:20 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Volume c57d01e7-4b16-4196-af70-69372a603295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c57d01e7-4b16-4196-af70-69372a603295', 'volume_size': 1} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] Created reservations ['6295d4a2-f91c-4dcd-89bf-5acf2ff93156', '6ab34c1f-e409-4017-a93d-7de4fc2aa94b', '160586a4-1211-4615-95a5-4b19d22b469a', '203d1eba-e6c4-49b6-9b8e-f6d97bf7a1d8'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:20 devstack sudo[86365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:06:20 devstack sudo[86365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:21 devstack sudo[86362]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a08857a5-d008-4456-a535-cf0455e0f6fe 2147483648" returned: 0 in 0.764s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a08857a5-d008-4456-a535-cf0455e0f6fe {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:21 devstack sudo[86365]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.648s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:21 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] Deleted volume successfully. Feb 27 02:06:21 devstack sudo[86372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a08857a5-d008-4456-a535-cf0455e0f6fe Feb 27 02:06:21 devstack sudo[86372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e146b46c-f171-40b6-a311-48260c935ff5 tempest-VolumesImageMetadata-562325724 None] Lock "cinder-7f5ca1aa-91b0-4b7e-b9b5-a760edb16ee8-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:21 devstack sudo[86372]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a08857a5-d008-4456-a535-cf0455e0f6fe" returned: 0 in 0.716s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.405s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-693996489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57d01e7-4b16-4196-af70-69372a603295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94a8ef129b194740b0cf6daa5f2b5eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:20Z,use_quota=True,user_id='27b3d923d7154a2587a28ad7132c5487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Creating volume c57d01e7-4b16-4196-af70-69372a603295 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:21 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c57d01e7-4b16-4196-af70-69372a603295 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c4098d-0d95-46ea-8a3e-23b120791254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a08857a5-d008-4456-a535-cf0455e0f6fe', 'volume_size': 2}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d03580-e98c-4cee-8048-79ee11b3dd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:21 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Volume volume-a08857a5-d008-4456-a535-cf0455e0f6fe (a08857a5-d008-4456-a535-cf0455e0f6fe): created successfully Feb 27 02:06:21 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c57d01e7-4b16-4196-af70-69372a603295 1073741824 Feb 27 02:06:21 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d03580-e98c-4cee-8048-79ee11b3dd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:21 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Flow 'volume_create_manager' (ab73c1e2-77b8-462a-98dc-0facc91967ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:21 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-94063a8e-e0a4-4c2c-b45a-0924c12c535f tempest-VolumesCloneNegativeTest-1567386259 None] Created volume successfully. Feb 27 02:06:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ad4a0d93-7312-41eb-b6a5-321c00482269 tempest-VolumesCloneNegativeTest-1567386259 None] Acquiring lock "cinder-a08857a5-d008-4456-a535-cf0455e0f6fe-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ad4a0d93-7312-41eb-b6a5-321c00482269 tempest-VolumesCloneNegativeTest-1567386259 None] Lock "cinder-a08857a5-d008-4456-a535-cf0455e0f6fe-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ad4a0d93-7312-41eb-b6a5-321c00482269 tempest-VolumesCloneNegativeTest-1567386259 None] Acquiring lock "cinder-quobyte-a08857a5-d008-4456-a535-cf0455e0f6fe" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ad4a0d93-7312-41eb-b6a5-321c00482269 tempest-VolumesCloneNegativeTest-1567386259 None] Lock "cinder-quobyte-a08857a5-d008-4456-a535-cf0455e0f6fe" acquired by "delete_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:22 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d340c4a-bb46-4891-9b5c-1b989e994d0c]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad4a0d93-7312-41eb-b6a5-321c00482269 tempest-VolumesCloneNegativeTest-1567386259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a08857a5-d008-4456-a535-cf0455e0f6fe {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:22 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c57d01e7-4b16-4196-af70-69372a603295 1073741824" returned: 0 in 0.889s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c57d01e7-4b16-4196-af70-69372a603295 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:22 devstack sudo[86405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a08857a5-d008-4456-a535-cf0455e0f6fe Feb 27 02:06:22 devstack sudo[86405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:22 devstack sudo[86407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c57d01e7-4b16-4196-af70-69372a603295 Feb 27 02:06:22 devstack sudo[86407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:23 devstack sudo[86405]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad4a0d93-7312-41eb-b6a5-321c00482269 tempest-VolumesCloneNegativeTest-1567386259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a08857a5-d008-4456-a535-cf0455e0f6fe" returned: 0 in 0.713s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad4a0d93-7312-41eb-b6a5-321c00482269 tempest-VolumesCloneNegativeTest-1567386259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a08857a5-d008-4456-a535-cf0455e0f6fe {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:23 devstack sudo[86413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a08857a5-d008-4456-a535-cf0455e0f6fe Feb 27 02:06:23 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:23 devstack sudo[86407]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c57d01e7-4b16-4196-af70-69372a603295" returned: 0 in 0.832s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2927e795-da9b-415f-9161-4f250f8d6f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c57d01e7-4b16-4196-af70-69372a603295', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acee0cd1-3485-4ca7-b4e1-ec8f9dd442f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:23 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Volume volume-c57d01e7-4b16-4196-af70-69372a603295 (c57d01e7-4b16-4196-af70-69372a603295): created successfully Feb 27 02:06:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acee0cd1-3485-4ca7-b4e1-ec8f9dd442f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Flow 'volume_create_manager' (d5c2fba0-2dcf-45c1-ba9a-94f52bd671d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:23 devstack cinder-volume[82738]: DEBUG oslo_service.periodic_task [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82738) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:06:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:23 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-477d5f1e-88bc-4ed3-ae07-5d6f5ef157d3 tempest-VolumesTransfersV357Test-1867962345 None] Created volume successfully. Feb 27 02:06:23 devstack sudo[86415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:06:23 devstack sudo[86415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:24 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad4a0d93-7312-41eb-b6a5-321c00482269 tempest-VolumesCloneNegativeTest-1567386259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a08857a5-d008-4456-a535-cf0455e0f6fe" returned: 0 in 0.832s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:24 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ad4a0d93-7312-41eb-b6a5-321c00482269 tempest-VolumesCloneNegativeTest-1567386259 None] Lock "cinder-quobyte-a08857a5-d008-4456-a535-cf0455e0f6fe" released by "delete_volume" :: held 1.597s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:24 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-ad4a0d93-7312-41eb-b6a5-321c00482269 tempest-VolumesCloneNegativeTest-1567386259 None] Created reservations ['7141bb2b-8ab9-42b5-b510-2f2865cfc60a', 'edf7d686-270a-473e-86e2-1cc05ac8cf33', '259a70f8-947e-4928-9fb3-4e8f1b2be593', '73031c95-4c80-45da-be60-59d794e66ebb'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ad4a0d93-7312-41eb-b6a5-321c00482269 tempest-VolumesCloneNegativeTest-1567386259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ad4a0d93-7312-41eb-b6a5-321c00482269 tempest-VolumesCloneNegativeTest-1567386259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:24 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ad4a0d93-7312-41eb-b6a5-321c00482269 tempest-VolumesCloneNegativeTest-1567386259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:24 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ad4a0d93-7312-41eb-b6a5-321c00482269 tempest-VolumesCloneNegativeTest-1567386259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ad4a0d93-7312-41eb-b6a5-321c00482269 tempest-VolumesCloneNegativeTest-1567386259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad4a0d93-7312-41eb-b6a5-321c00482269 tempest-VolumesCloneNegativeTest-1567386259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:24 devstack sudo[86415]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.835s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:24 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:24 devstack sudo[86419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:06:24 devstack sudo[86419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:25 devstack sudo[86419]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ad4a0d93-7312-41eb-b6a5-321c00482269 tempest-VolumesCloneNegativeTest-1567386259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.841s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:25 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-ad4a0d93-7312-41eb-b6a5-321c00482269 tempest-VolumesCloneNegativeTest-1567386259 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:25 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-ad4a0d93-7312-41eb-b6a5-321c00482269 tempest-VolumesCloneNegativeTest-1567386259 None] Deleted volume successfully. Feb 27 02:06:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ad4a0d93-7312-41eb-b6a5-321c00482269 tempest-VolumesCloneNegativeTest-1567386259 None] Lock "cinder-a08857a5-d008-4456-a535-cf0455e0f6fe-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:25 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-86bf563a-e545-43ba-ba43-bb29728bc9a4 tempest-VolumesTransfersV357Test-68400162 None] Transfer volume completed successfully. Feb 27 02:06:26 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-cf2b41eb-37f6-4a89-a00c-7c47288f8d33 tempest-VolumesTransfersV357Test-285005579 None] Acquiring lock "cinder-c57d01e7-4b16-4196-af70-69372a603295-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:26 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-cf2b41eb-37f6-4a89-a00c-7c47288f8d33 tempest-VolumesTransfersV357Test-285005579 None] Lock "cinder-c57d01e7-4b16-4196-af70-69372a603295-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:26 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Flow 'volume_create_manager' (cfd0a235-2d1a-4b1c-be78-3cd7324d4bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f018c647-3fd7-4b86-bf5e-80518f01e09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f018c647-3fd7-4b86-bf5e-80518f01e09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1775183652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea2c196d-67f8-4997-ada0-89fe79a3e015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0024859a00824f1fa6aaf94389b39f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:27Z,use_quota=True,user_id='bbb84fc9ddb84969925410f55a9af3df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df0c707-7c63-4d2e-a71c-fc8b488b2637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df0c707-7c63-4d2e-a71c-fc8b488b2637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5868acc-1030-48ba-8b7d-67d21122a2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5868acc-1030-48ba-8b7d-67d21122a2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea2c196d-67f8-4997-ada0-89fe79a3e015', 'volume_name': 'volume-ea2c196d-67f8-4997-ada0-89fe79a3e015', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (556abbcb-1e4d-49d6-8415-c6edc7db2b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (556abbcb-1e4d-49d6-8415-c6edc7db2b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce8eac0-f28a-4445-ae5b-433b18f0c2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:27 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Volume ea2c196d-67f8-4997-ada0-89fe79a3e015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea2c196d-67f8-4997-ada0-89fe79a3e015', 'volume_size': 1} Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1775183652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea2c196d-67f8-4997-ada0-89fe79a3e015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0024859a00824f1fa6aaf94389b39f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:27Z,use_quota=True,user_id='bbb84fc9ddb84969925410f55a9af3df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Creating volume ea2c196d-67f8-4997-ada0-89fe79a3e015 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:27 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-cf2b41eb-37f6-4a89-a00c-7c47288f8d33 tempest-VolumesTransfersV357Test-285005579 None] Acquiring lock "cinder-quobyte-c57d01e7-4b16-4196-af70-69372a603295" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-cf2b41eb-37f6-4a89-a00c-7c47288f8d33 tempest-VolumesTransfersV357Test-285005579 None] Lock "cinder-quobyte-c57d01e7-4b16-4196-af70-69372a603295" acquired by "delete_volume" :: waited 0.015s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:27 devstack sudo[86422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 1073741824 Feb 27 02:06:27 devstack sudo[86422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c39355-fdf4-43ff-81e5-bf160a62bddb]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cf2b41eb-37f6-4a89-a00c-7c47288f8d33 tempest-VolumesTransfersV357Test-285005579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c57d01e7-4b16-4196-af70-69372a603295 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:27 devstack sudo[86424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c57d01e7-4b16-4196-af70-69372a603295 Feb 27 02:06:27 devstack sudo[86424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:28 devstack sudo[86424]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cf2b41eb-37f6-4a89-a00c-7c47288f8d33 tempest-VolumesTransfersV357Test-285005579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c57d01e7-4b16-4196-af70-69372a603295" returned: 0 in 1.050s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cf2b41eb-37f6-4a89-a00c-7c47288f8d33 tempest-VolumesTransfersV357Test-285005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c57d01e7-4b16-4196-af70-69372a603295 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:28 devstack sudo[86432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c57d01e7-4b16-4196-af70-69372a603295 Feb 27 02:06:28 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:28 devstack sudo[86422]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 1073741824" returned: 0 in 1.175s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:28 devstack sudo[86434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 Feb 27 02:06:28 devstack sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:28 devstack sudo[86434]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015" returned: 0 in 0.580s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:28 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:28 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce8eac0-f28a-4445-ae5b-433b18f0c2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea2c196d-67f8-4997-ada0-89fe79a3e015', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:28 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cda7c38-c67b-4d42-a500-5c220cd437ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:28 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Volume volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 (ea2c196d-67f8-4997-ada0-89fe79a3e015): created successfully Feb 27 02:06:28 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cda7c38-c67b-4d42-a500-5c220cd437ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:28 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Flow 'volume_create_manager' (cfd0a235-2d1a-4b1c-be78-3cd7324d4bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:28 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-67baf398-ffe1-49b9-8073-68e4e3368edb tempest-VolumesCloneTest-1182883598 None] Created volume successfully. Feb 27 02:06:28 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Flow 'volume_create_manager' (631b741f-e4fa-4485-898c-4a072ad8c4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3aaf9d4-efc2-4ae2-bcd7-50ab4a892d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3aaf9d4-efc2-4ae2-bcd7-50ab4a892d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-530044180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5556ee63-76b7-4c72-bb52-e96cdc3ed812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f005938afb84369b3b5ef0463db6d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:29Z,use_quota=True,user_id='43e3fec16f3142dea5d0eac1a2576eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba027253-7b9f-4d80-a833-f42cdca11970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba027253-7b9f-4d80-a833-f42cdca11970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c03083-f27b-435f-b59d-6fa0a504c81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG cinder.image.glance [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Creating Keystone auth plugin from conf {{(pid=82738) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 02:06:29 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cf2b41eb-37f6-4a89-a00c-7c47288f8d33 tempest-VolumesTransfersV357Test-285005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c57d01e7-4b16-4196-af70-69372a603295" returned: 0 in 0.929s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-cf2b41eb-37f6-4a89-a00c-7c47288f8d33 tempest-VolumesTransfersV357Test-285005579 None] Lock "cinder-quobyte-c57d01e7-4b16-4196-af70-69372a603295" released by "delete_volume" :: held 2.042s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-cf2b41eb-37f6-4a89-a00c-7c47288f8d33 tempest-VolumesTransfersV357Test-285005579 None] Created reservations ['d9038e6e-7051-4319-b89e-b0d090e54afe', 'd2fa1de9-3950-4e11-b045-3d4afc4ca945', '6ee89c6b-06ff-4927-afa6-f578986c603f', 'fb77d0ef-6bb6-44da-bc39-ab0101a662f7'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cf2b41eb-37f6-4a89-a00c-7c47288f8d33 tempest-VolumesTransfersV357Test-285005579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cf2b41eb-37f6-4a89-a00c-7c47288f8d33 tempest-VolumesTransfersV357Test-285005579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-cf2b41eb-37f6-4a89-a00c-7c47288f8d33 tempest-VolumesTransfersV357Test-285005579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-cf2b41eb-37f6-4a89-a00c-7c47288f8d33 tempest-VolumesTransfersV357Test-285005579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cf2b41eb-37f6-4a89-a00c-7c47288f8d33 tempest-VolumesTransfersV357Test-285005579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cf2b41eb-37f6-4a89-a00c-7c47288f8d33 tempest-VolumesTransfersV357Test-285005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:29 devstack sudo[86441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:06:29 devstack sudo[86441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c03083-f27b-435f-b59d-6fa0a504c81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5556ee63-76b7-4c72-bb52-e96cdc3ed812', 'volume_name': 'volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812', 'volume_size': 1, 'image_id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db1770ccb718417cb73a54677fa92116', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'created_at': datetime.datetime(2026, 2, 27, 0, 57, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b706c9e-6966-424a-b9ee-45ddbab3a331/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377cedb8-5b45-4f5b-bdc5-1d397888894e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377cedb8-5b45-4f5b-bdc5-1d397888894e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a4f742-59b3-4e23-8a14-65ed9336f4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:29 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Volume 5556ee63-76b7-4c72-bb52-e96cdc3ed812: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812', 'volume_size': 1, 'image_id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db1770ccb718417cb73a54677fa92116', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'created_at': datetime.datetime(2026, 2, 27, 0, 57, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b706c9e-6966-424a-b9ee-45ddbab3a331/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Trying to clone 5556ee63-76b7-4c72-bb52-e96cdc3ed812 from image 4b706c9e-6966-424a-b9ee-45ddbab3a331 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}]). {{(pid=82738) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ebi60en2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82738) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 02:06:29 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Image download 20.69 MB at 20.69 MB/s Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[727cd684-360e-42c2-88bc-b37acff3bb3f]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ebi60en2devstack@QuobyteHD {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:29 devstack sudo[86444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ebi60en2devstack@QuobyteHD Feb 27 02:06:29 devstack sudo[86444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:29 devstack sudo[86441]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cf2b41eb-37f6-4a89-a00c-7c47288f8d33 tempest-VolumesTransfersV357Test-285005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.700s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:29 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-cf2b41eb-37f6-4a89-a00c-7c47288f8d33 tempest-VolumesTransfersV357Test-285005579 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:30 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-cf2b41eb-37f6-4a89-a00c-7c47288f8d33 tempest-VolumesTransfersV357Test-285005579 None] Deleted volume successfully. Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-cf2b41eb-37f6-4a89-a00c-7c47288f8d33 tempest-VolumesTransfersV357Test-285005579 None] Lock "cinder-c57d01e7-4b16-4196-af70-69372a603295-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Flow 'volume_create_manager' (6864f174-de8c-4a59-8b25-305680f3986f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f64b0ae-b021-4e2a-b1c3-88fc778e1d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f64b0ae-b021-4e2a-b1c3-88fc778e1d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1876619426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe1f007-4279-4a4c-bd16-b8a8b0704ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0024859a00824f1fa6aaf94389b39f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=ea2c196d-67f8-4997-ada0-89fe79a3e015,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:30Z,use_quota=True,user_id='bbb84fc9ddb84969925410f55a9af3df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01864895-652d-44d4-9fd9-c8f4f476f917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01864895-652d-44d4-9fd9-c8f4f476f917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3b15e4-e900-407c-aa2a-65caef37d70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3b15e4-e900-407c-aa2a-65caef37d70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7fe1f007-4279-4a4c-bd16-b8a8b0704ff4', 'volume_name': 'volume-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4', 'volume_size': 2, 'source_volid': 'ea2c196d-67f8-4997-ada0-89fe79a3e015', 'source_volstatus': 'available'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f7ecce-17da-4d28-87e3-8217c3a2edaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f7ecce-17da-4d28-87e3-8217c3a2edaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78771f57-1825-44c8-af21-73da166f00af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:30 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Volume 7fe1f007-4279-4a4c-bd16-b8a8b0704ff4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4', 'volume_size': 2, 'source_volid': 'ea2c196d-67f8-4997-ada0-89fe79a3e015', 'source_volstatus': 'available'} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:30 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Cloning volume ea2c196d-67f8-4997-ada0-89fe79a3e015 to volume 7fe1f007-4279-4a4c-bd16-b8a8b0704ff4 Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Creating offline snapshot 353e4f25-af19-4fab-943e-cf04562e8010 of volume ea2c196d-67f8-4997-ada0-89fe79a3e015 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62b58b8-555d-40ec-8f95-4219f8e8dea9]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:30 devstack sudo[86447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 Feb 27 02:06:30 devstack sudo[86447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:30 devstack sudo[86444]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ebi60en2devstack@QuobyteHD" returned: 0 in 0.669s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Temporary image 4b706c9e-6966-424a-b9ee-45ddbab3a331 is fetched for user 43e3fec16f3142dea5d0eac1a2576eff. {{(pid=82738) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4af08bb-8ec5-44a4-935a-e49c358eb40c]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ebi60en2devstack@QuobyteHD {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:30 devstack sudo[86453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ebi60en2devstack@QuobyteHD Feb 27 02:06:30 devstack sudo[86453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Flow 'volume_create_manager' (a7dffaff-9ee8-4f2b-bb7a-760e629b3b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f30088-5c19-4005-a77b-32c22629b1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f30088-5c19-4005-a77b-32c22629b1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1085168365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=267db0fd-1809-40f0-b96e-60f75e9ed321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94a8ef129b194740b0cf6daa5f2b5eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:31Z,use_quota=True,user_id='27b3d923d7154a2587a28ad7132c5487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e34197-6c0d-42d8-b8ec-3bd020f18823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e34197-6c0d-42d8-b8ec-3bd020f18823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5243a46-5b83-4379-9abe-6475cdd84328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5243a46-5b83-4379-9abe-6475cdd84328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '267db0fd-1809-40f0-b96e-60f75e9ed321', 'volume_name': 'volume-267db0fd-1809-40f0-b96e-60f75e9ed321', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae2e794-2313-44ca-80be-c7ea7180e8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae2e794-2313-44ca-80be-c7ea7180e8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1319ed7-4525-4899-a7ae-a6354f3e6728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:30 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Volume 267db0fd-1809-40f0-b96e-60f75e9ed321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-267db0fd-1809-40f0-b96e-60f75e9ed321', 'volume_size': 1} Feb 27 02:06:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:31 devstack sudo[86447]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015" returned: 0 in 0.755s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:31 devstack sudo[86458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010 1G Feb 27 02:06:31 devstack sudo[86458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:31 devstack sudo[86453]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ebi60en2devstack@QuobyteHD" returned: 0 in 0.787s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:31 devstack sudo[86458]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010 1G" returned: 0 in 0.728s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:31 devstack sudo[86466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010 Feb 27 02:06:31 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:32 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010" returned: 0 in 0.588s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:32 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010 is being set with open permissions: ugo+rw Feb 27 02:06:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:32 devstack sudo[86471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010 Feb 27 02:06:32 devstack sudo[86471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:32 devstack sudo[86471]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010" returned: 0 in 0.570s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:32 devstack sudo[86474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.info Feb 27 02:06:32 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:33 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.info" returned: 0 in 0.604s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:33 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.info is being set with open permissions: ugo+rw Feb 27 02:06:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:33 devstack sudo[86477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.info Feb 27 02:06:33 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:34 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.info" returned: 0 in 0.563s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:34 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Acquiring lock "cinder-quobyte-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4" by "_copy_volume_from_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:34 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Lock "cinder-quobyte-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:34 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] snapshot: 353e4f25-af19-4fab-943e-cf04562e8010, volume: 7fe1f007-4279-4a4c-bd16-b8a8b0704ff4, {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:06:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:34 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:34 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:34 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f44b33c-b5c8-4dec-ad6d-3312670a6f57]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:34 devstack sudo[86497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010 Feb 27 02:06:34 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Flow 'volume_create_manager' (1870c611-6706-427a-aaed-789c50b29d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cecd5cf-55de-41c8-8e10-753a5f2e806a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cecd5cf-55de-41c8-8e10-753a5f2e806a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:35Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ff9307-1fe5-467d-97d0-c55efc019f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f2eb4564344471a74f1556cc267200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:35Z,use_quota=True,user_id='a872712bbdfe46de983fba404eeda58d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3701b7-79df-41c6-a88e-99b0ff677e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3701b7-79df-41c6-a88e-99b0ff677e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216524a3-5477-4e8c-9375-344de3fb4706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG cinder.image.glance [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Creating Keystone auth plugin from conf {{(pid=82738) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 02:06:35 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010" returned: 0 in 1.083s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea2c196d-67f8-4997-ada0-89fe79a3e015(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Creating direct copy from snapshot {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dd3e69-c6ef-4656-b6f1-1c6542cb056a]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216524a3-5477-4e8c-9375-344de3fb4706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '66ff9307-1fe5-467d-97d0-c55efc019f7b', 'volume_name': 'volume-66ff9307-1fe5-467d-97d0-c55efc019f7b', 'volume_size': 1, 'image_id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db1770ccb718417cb73a54677fa92116', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'created_at': datetime.datetime(2026, 2, 27, 0, 57, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b706c9e-6966-424a-b9ee-45ddbab3a331/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c4d3268-84a4-4b86-b0fa-50b5ce0b09b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c4d3268-84a4-4b86-b0fa-50b5ce0b09b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ecaa91-88b0-481e-bb33-adf5cbe9e695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:35 devstack sudo[86504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 Feb 27 02:06:35 devstack sudo[86504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:35 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Volume 66ff9307-1fe5-467d-97d0-c55efc019f7b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-66ff9307-1fe5-467d-97d0-c55efc019f7b', 'volume_size': 1, 'image_id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db1770ccb718417cb73a54677fa92116', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'created_at': datetime.datetime(2026, 2, 27, 0, 57, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b706c9e-6966-424a-b9ee-45ddbab3a331/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Trying to clone 66ff9307-1fe5-467d-97d0-c55efc019f7b from image 4b706c9e-6966-424a-b9ee-45ddbab3a331 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}]). {{(pid=82738) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ggnazu9odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82738) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 02:06:35 devstack cinder-volume[82738]: INFO cinder.image.image_utils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Image download 20.69 MB at 20.69 MB/s Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca847a13-841f-4dce-b2e6-37eb4f96c10b]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ggnazu9odevstack@QuobyteHD {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:35 devstack sudo[86507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ggnazu9odevstack@QuobyteHD Feb 27 02:06:35 devstack sudo[86507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:36 devstack sudo[86504]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015" returned: 0 in 0.976s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:36 devstack cinder-volume[82738]: DEBUG cinder.utils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Path /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4 not found in is_blk_device check {{(pid=82738) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:06:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:36 devstack sudo[86512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4 Feb 27 02:06:36 devstack sudo[86512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:36 devstack sudo[86507]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ggnazu9odevstack@QuobyteHD" returned: 0 in 0.886s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:36 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Temporary image 4b706c9e-6966-424a-b9ee-45ddbab3a331 is fetched for user a872712bbdfe46de983fba404eeda58d. {{(pid=82738) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 02:06:36 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d836af8-be45-432e-a985-57691d5f9b4e]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ggnazu9odevstack@QuobyteHD {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:36 devstack sudo[86517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ggnazu9odevstack@QuobyteHD Feb 27 02:06:36 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:37 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ggnazu9odevstack@QuobyteHD" returned: 0 in 0.791s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:39 devstack sudo[86512]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4" returned: 0 in 3.024s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:39 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba216dd2-c92c-409f-a46b-c38289c39cfb]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:39 devstack sudo[86532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 Feb 27 02:06:39 devstack sudo[86532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:40 devstack sudo[86532]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015" returned: 0 in 0.785s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:40 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015, size 1024.00 MB, duration 3.02 sec, destination /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4 {{(pid=82738) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:06:40 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Converted 1024.00 MB image at 338.58 MB/s Feb 27 02:06:40 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4 is being set with open permissions: ugo+rw Feb 27 02:06:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:40 devstack sudo[86546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4 Feb 27 02:06:40 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:40 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4" returned: 0 in 0.585s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:40 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Lock "cinder-quobyte-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4" released by "_copy_volume_from_snapshot" :: held 6.545s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:40 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Acquiring lock "cinder-quobyte-353e4f25-af19-4fab-943e-cf04562e8010" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:40 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Lock "cinder-quobyte-353e4f25-af19-4fab-943e-cf04562e8010" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:40 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Deleting offline snapshot 353e4f25-af19-4fab-943e-cf04562e8010 of volume ea2c196d-67f8-4997-ada0-89fe79a3e015 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:06:40 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] snapshot_file for this snap is: volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:06:40 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[68675842-4dfc-4074-9423-f40285388a9e]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:40 devstack sudo[86550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010 Feb 27 02:06:40 devstack sudo[86550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:41 devstack sudo[86550]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010" returned: 0 in 0.695s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:41 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea2c196d-67f8-4997-ada0-89fe79a3e015(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:41 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[6216574f-2c83-48d1-ac41-7864aded9479]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:41 devstack sudo[86555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 Feb 27 02:06:41 devstack sudo[86555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:42 devstack sudo[86555]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015" returned: 0 in 0.808s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:42 devstack sudo[86563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010 Feb 27 02:06:42 devstack sudo[86563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:42 devstack sudo[86563]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010" returned: 0 in 0.511s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:42 devstack sudo[86568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010 Feb 27 02:06:42 devstack sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:43 devstack sudo[86568]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015.353e4f25-af19-4fab-943e-cf04562e8010" returned: 0 in 0.471s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Lock "cinder-quobyte-353e4f25-af19-4fab-943e-cf04562e8010" released by "_delete_snapshot" :: held 2.564s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.108s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.488s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:43 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1085168365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=267db0fd-1809-40f0-b96e-60f75e9ed321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94a8ef129b194740b0cf6daa5f2b5eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:31Z,use_quota=True,user_id='27b3d923d7154a2587a28ad7132c5487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:43 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Creating volume 267db0fd-1809-40f0-b96e-60f75e9ed321 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:43 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:43 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:43 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:43 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:06:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-267db0fd-1809-40f0-b96e-60f75e9ed321 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:43 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78771f57-1825-44c8-af21-73da166f00af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4', 'volume_size': 2, 'source_volid': 'ea2c196d-67f8-4997-ada0-89fe79a3e015', 'source_volstatus': 'available'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:43 devstack sudo[86571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-267db0fd-1809-40f0-b96e-60f75e9ed321 1073741824 Feb 27 02:06:43 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:43 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a0c70e-0b9b-482d-b887-699d099cca47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:43 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Volume volume-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4 (7fe1f007-4279-4a4c-bd16-b8a8b0704ff4): created successfully Feb 27 02:06:43 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a0c70e-0b9b-482d-b887-699d099cca47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:43 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Flow 'volume_create_manager' (6864f174-de8c-4a59-8b25-305680f3986f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:43 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-861a6178-7a06-45c5-b14c-865e4c5295ca tempest-VolumesCloneTest-1182883598 None] Created volume successfully. Feb 27 02:06:43 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-267db0fd-1809-40f0-b96e-60f75e9ed321 1073741824" returned: 0 in 0.669s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-267db0fd-1809-40f0-b96e-60f75e9ed321 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:44 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-267db0fd-1809-40f0-b96e-60f75e9ed321 Feb 27 02:06:44 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b6c1b96b-6805-48cb-ad23-f9b7be23cd7a tempest-VolumesCloneTest-1182883598 None] Acquiring lock "cinder-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b6c1b96b-6805-48cb-ad23-f9b7be23cd7a tempest-VolumesCloneTest-1182883598 None] Lock "cinder-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b6c1b96b-6805-48cb-ad23-f9b7be23cd7a tempest-VolumesCloneTest-1182883598 None] Acquiring lock "cinder-quobyte-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b6c1b96b-6805-48cb-ad23-f9b7be23cd7a tempest-VolumesCloneTest-1182883598 None] Lock "cinder-quobyte-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4" acquired by "delete_volume" :: waited 0.019s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[1248fd9d-a95a-4f3e-af81-2c92d9239890]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b6c1b96b-6805-48cb-ad23-f9b7be23cd7a tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:44 devstack sudo[86578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4 Feb 27 02:06:44 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:44 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-267db0fd-1809-40f0-b96e-60f75e9ed321" returned: 0 in 0.605s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.385s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-530044180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5556ee63-76b7-4c72-bb52-e96cdc3ed812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f005938afb84369b3b5ef0463db6d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:29Z,use_quota=True,user_id='43e3fec16f3142dea5d0eac1a2576eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Creating volume 5556ee63-76b7-4c72-bb52-e96cdc3ed812 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:44 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1319ed7-4525-4899-a7ae-a6354f3e6728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-267db0fd-1809-40f0-b96e-60f75e9ed321', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64547d7a-3fec-42fc-b60d-451ebe7b176f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:44 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Volume volume-267db0fd-1809-40f0-b96e-60f75e9ed321 (267db0fd-1809-40f0-b96e-60f75e9ed321): created successfully Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64547d7a-3fec-42fc-b60d-451ebe7b176f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:44 devstack sudo[86581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 1073741824 Feb 27 02:06:44 devstack sudo[86581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Flow 'volume_create_manager' (a7dffaff-9ee8-4f2b-bb7a-760e629b3b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:44 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-7fdb27ad-c5f4-4c11-9ef4-383539079933 tempest-VolumesTransfersV357Test-1867962345 None] Created volume successfully. Feb 27 02:06:45 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b6c1b96b-6805-48cb-ad23-f9b7be23cd7a tempest-VolumesCloneTest-1182883598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4" returned: 0 in 0.711s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b6c1b96b-6805-48cb-ad23-f9b7be23cd7a tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:45 devstack sudo[86586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4 Feb 27 02:06:45 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b7b5e386-56d0-4006-bc91-8ae06ca2ae8b tempest-VolumesTransfersV357Test-285005579 None] Acquiring lock "cinder-267db0fd-1809-40f0-b96e-60f75e9ed321-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b7b5e386-56d0-4006-bc91-8ae06ca2ae8b tempest-VolumesTransfersV357Test-285005579 None] Lock "cinder-267db0fd-1809-40f0-b96e-60f75e9ed321-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b7b5e386-56d0-4006-bc91-8ae06ca2ae8b tempest-VolumesTransfersV357Test-285005579 None] Acquiring lock "cinder-quobyte-267db0fd-1809-40f0-b96e-60f75e9ed321" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b7b5e386-56d0-4006-bc91-8ae06ca2ae8b tempest-VolumesTransfersV357Test-285005579 None] Lock "cinder-quobyte-267db0fd-1809-40f0-b96e-60f75e9ed321" acquired by "delete_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:45 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ed0ba0-9d80-4af2-94cb-6070acd7cdad]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b7b5e386-56d0-4006-bc91-8ae06ca2ae8b tempest-VolumesTransfersV357Test-285005579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-267db0fd-1809-40f0-b96e-60f75e9ed321 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:45 devstack sudo[86581]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 1073741824" returned: 0 in 0.843s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:45 devstack sudo[86592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-267db0fd-1809-40f0-b96e-60f75e9ed321 Feb 27 02:06:45 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:45 devstack sudo[86593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 Feb 27 02:06:45 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:45 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b6c1b96b-6805-48cb-ad23-f9b7be23cd7a tempest-VolumesCloneTest-1182883598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4" returned: 0 in 0.708s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b6c1b96b-6805-48cb-ad23-f9b7be23cd7a tempest-VolumesCloneTest-1182883598 None] Lock "cinder-quobyte-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4" released by "delete_volume" :: held 1.446s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:45 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-b6c1b96b-6805-48cb-ad23-f9b7be23cd7a tempest-VolumesCloneTest-1182883598 None] Created reservations ['da019a39-4ea3-4fee-bc01-241fc64e7307', 'fe122d08-7737-4c70-9de8-4550c38cdf9d', '43ccbd4a-0d81-480c-9a75-fc99945835b3', 'ef1fceac-5e5e-4022-934a-2ca339f72f71'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b6c1b96b-6805-48cb-ad23-f9b7be23cd7a tempest-VolumesCloneTest-1182883598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b6c1b96b-6805-48cb-ad23-f9b7be23cd7a tempest-VolumesCloneTest-1182883598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b6c1b96b-6805-48cb-ad23-f9b7be23cd7a tempest-VolumesCloneTest-1182883598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b6c1b96b-6805-48cb-ad23-f9b7be23cd7a tempest-VolumesCloneTest-1182883598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b6c1b96b-6805-48cb-ad23-f9b7be23cd7a tempest-VolumesCloneTest-1182883598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b6c1b96b-6805-48cb-ad23-f9b7be23cd7a tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:46 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:06:46 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:46 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812" returned: 0 in 0.630s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.705s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:35Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ff9307-1fe5-467d-97d0-c55efc019f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f2eb4564344471a74f1556cc267200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:35Z,use_quota=True,user_id='a872712bbdfe46de983fba404eeda58d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Creating volume 66ff9307-1fe5-467d-97d0-c55efc019f7b {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:46 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:46 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b7b5e386-56d0-4006-bc91-8ae06ca2ae8b tempest-VolumesTransfersV357Test-285005579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-267db0fd-1809-40f0-b96e-60f75e9ed321" returned: 0 in 0.831s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b7b5e386-56d0-4006-bc91-8ae06ca2ae8b tempest-VolumesTransfersV357Test-285005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-267db0fd-1809-40f0-b96e-60f75e9ed321 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:46 devstack sudo[86603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b 1073741824 Feb 27 02:06:46 devstack sudo[86603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:46 devstack sudo[86604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-267db0fd-1809-40f0-b96e-60f75e9ed321 Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG cinder.volume.volume_utils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Attempting download of 4b706c9e-6966-424a-b9ee-45ddbab3a331 ((None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}])) to volume 5556ee63-76b7-4c72-bb52-e96cdc3ed812. {{(pid=82738) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 02:06:46 devstack sudo[86604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c26560-9486-474d-a01c-3342960eb49e]: (4, 'raw') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_edcbkcn8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:46 devstack sudo[86607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_edcbkcn8 Feb 27 02:06:46 devstack sudo[86607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-151d53f3-95a5-4cca-b1be-9ab5e2193f1c tempest-VolumesCloneTest-1182883598 None] Acquiring lock "cinder-ea2c196d-67f8-4997-ada0-89fe79a3e015-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-151d53f3-95a5-4cca-b1be-9ab5e2193f1c tempest-VolumesCloneTest-1182883598 None] Lock "cinder-ea2c196d-67f8-4997-ada0-89fe79a3e015-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-151d53f3-95a5-4cca-b1be-9ab5e2193f1c tempest-VolumesCloneTest-1182883598 None] Acquiring lock "cinder-quobyte-ea2c196d-67f8-4997-ada0-89fe79a3e015" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-151d53f3-95a5-4cca-b1be-9ab5e2193f1c tempest-VolumesCloneTest-1182883598 None] Lock "cinder-quobyte-ea2c196d-67f8-4997-ada0-89fe79a3e015" acquired by "delete_volume" :: waited 0.034s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a79024-d5de-4545-ab49-643b4ba41f47]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-151d53f3-95a5-4cca-b1be-9ab5e2193f1c tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:46 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b6c1b96b-6805-48cb-ad23-f9b7be23cd7a tempest-VolumesCloneTest-1182883598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.911s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-b6c1b96b-6805-48cb-ad23-f9b7be23cd7a tempest-VolumesCloneTest-1182883598 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:46 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-b6c1b96b-6805-48cb-ad23-f9b7be23cd7a tempest-VolumesCloneTest-1182883598 None] Deleted volume successfully. Feb 27 02:06:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b6c1b96b-6805-48cb-ad23-f9b7be23cd7a tempest-VolumesCloneTest-1182883598 None] Lock "cinder-7fe1f007-4279-4a4c-bd16-b8a8b0704ff4-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:47 devstack sudo[86604]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b7b5e386-56d0-4006-bc91-8ae06ca2ae8b tempest-VolumesTransfersV357Test-285005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-267db0fd-1809-40f0-b96e-60f75e9ed321" returned: 0 in 0.775s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b7b5e386-56d0-4006-bc91-8ae06ca2ae8b tempest-VolumesTransfersV357Test-285005579 None] Lock "cinder-quobyte-267db0fd-1809-40f0-b96e-60f75e9ed321" released by "delete_volume" :: held 1.648s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:47 devstack sudo[86610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 Feb 27 02:06:47 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:47 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-b7b5e386-56d0-4006-bc91-8ae06ca2ae8b tempest-VolumesTransfersV357Test-285005579 None] Created reservations ['9946228d-84e6-43ac-b055-c7bfeb17c484', '5ff721ac-829f-4a0a-bc9b-f378b18308c6', '9387af36-050b-4052-960e-043df8fcc1bd', '505bba3a-48f7-4d96-b548-8cefc53e0ce6'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b7b5e386-56d0-4006-bc91-8ae06ca2ae8b tempest-VolumesTransfersV357Test-285005579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b7b5e386-56d0-4006-bc91-8ae06ca2ae8b tempest-VolumesTransfersV357Test-285005579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b7b5e386-56d0-4006-bc91-8ae06ca2ae8b tempest-VolumesTransfersV357Test-285005579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b7b5e386-56d0-4006-bc91-8ae06ca2ae8b tempest-VolumesTransfersV357Test-285005579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b7b5e386-56d0-4006-bc91-8ae06ca2ae8b tempest-VolumesTransfersV357Test-285005579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b7b5e386-56d0-4006-bc91-8ae06ca2ae8b tempest-VolumesTransfersV357Test-285005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:47 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:06:47 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:47 devstack sudo[86607]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_edcbkcn8" returned: 0 in 0.871s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_edcbkcn8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:47 devstack sudo[86603]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b 1073741824" returned: 0 in 1.096s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:47 devstack sudo[86620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_edcbkcn8 Feb 27 02:06:47 devstack sudo[86620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:47 devstack sudo[86622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b Feb 27 02:06:47 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:47 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-151d53f3-95a5-4cca-b1be-9ab5e2193f1c tempest-VolumesCloneTest-1182883598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015" returned: 0 in 1.026s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-151d53f3-95a5-4cca-b1be-9ab5e2193f1c tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:47 devstack sudo[86627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015 Feb 27 02:06:47 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:48 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b7b5e386-56d0-4006-bc91-8ae06ca2ae8b tempest-VolumesTransfersV357Test-285005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 1.065s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-b7b5e386-56d0-4006-bc91-8ae06ca2ae8b tempest-VolumesTransfersV357Test-285005579 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:48 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-b7b5e386-56d0-4006-bc91-8ae06ca2ae8b tempest-VolumesTransfersV357Test-285005579 None] Deleted volume successfully. Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b7b5e386-56d0-4006-bc91-8ae06ca2ae8b tempest-VolumesTransfersV357Test-285005579 None] Lock "cinder-267db0fd-1809-40f0-b96e-60f75e9ed321-delete_volume" released by "delete_volume" :: held 2.931s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:48 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b" returned: 0 in 0.943s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] <== create_volume: return (2120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.138s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:48 devstack sudo[86620]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_edcbkcn8" returned: 1 in 1.130s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_edcbkcn8' failed. Not Retrying. {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[25403d66-660e-4580-aec2-cf487552626c]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ebi60en2devstack@QuobyteHD {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG cinder.volume.volume_utils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Attempting download of 4b706c9e-6966-424a-b9ee-45ddbab3a331 ((None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}])) to volume 66ff9307-1fe5-467d-97d0-c55efc019f7b. {{(pid=82738) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[67661784-3ca8-4806-8e37-8197148df5b5]: (4, 'raw') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_23tghm77 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:48 devstack sudo[86633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ebi60en2devstack@QuobyteHD Feb 27 02:06:48 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:48 devstack sudo[86634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_23tghm77 Feb 27 02:06:48 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:48 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-151d53f3-95a5-4cca-b1be-9ab5e2193f1c tempest-VolumesCloneTest-1182883598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ea2c196d-67f8-4997-ada0-89fe79a3e015" returned: 0 in 0.793s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-151d53f3-95a5-4cca-b1be-9ab5e2193f1c tempest-VolumesCloneTest-1182883598 None] Lock "cinder-quobyte-ea2c196d-67f8-4997-ada0-89fe79a3e015" released by "delete_volume" :: held 1.901s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-151d53f3-95a5-4cca-b1be-9ab5e2193f1c tempest-VolumesCloneTest-1182883598 None] Created reservations ['9f23cac9-3226-4b6f-b660-3594d39781fb', '2267c9b9-578d-4bf0-af02-c3ac4833e684', '670f271d-7fb7-42ee-86d5-399566491a47', '8bbf637b-45be-43b7-9c16-cf3b8a453c48'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-151d53f3-95a5-4cca-b1be-9ab5e2193f1c tempest-VolumesCloneTest-1182883598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-151d53f3-95a5-4cca-b1be-9ab5e2193f1c tempest-VolumesCloneTest-1182883598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-151d53f3-95a5-4cca-b1be-9ab5e2193f1c tempest-VolumesCloneTest-1182883598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-151d53f3-95a5-4cca-b1be-9ab5e2193f1c tempest-VolumesCloneTest-1182883598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-151d53f3-95a5-4cca-b1be-9ab5e2193f1c tempest-VolumesCloneTest-1182883598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-151d53f3-95a5-4cca-b1be-9ab5e2193f1c tempest-VolumesCloneTest-1182883598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:48 devstack sudo[86638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:06:48 devstack sudo[86638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:49 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_23tghm77" returned: 0 in 0.875s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_23tghm77 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:49 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ebi60en2devstack@QuobyteHD" returned: 0 in 1.138s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:49 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] 4b706c9e-6966-424a-b9ee-45ddbab3a331 was qcow2, converting to raw {{(pid=82738) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 02:06:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ebi60en2devstack@QuobyteHD /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:49 devstack sudo[86642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_23tghm77 Feb 27 02:06:49 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:49 devstack sudo[86647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ebi60en2devstack@QuobyteHD /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 Feb 27 02:06:49 devstack sudo[86647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:49 devstack sudo[86638]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-151d53f3-95a5-4cca-b1be-9ab5e2193f1c tempest-VolumesCloneTest-1182883598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.991s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:49 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-151d53f3-95a5-4cca-b1be-9ab5e2193f1c tempest-VolumesCloneTest-1182883598 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:49 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-151d53f3-95a5-4cca-b1be-9ab5e2193f1c tempest-VolumesCloneTest-1182883598 None] Deleted volume successfully. Feb 27 02:06:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-151d53f3-95a5-4cca-b1be-9ab5e2193f1c tempest-VolumesCloneTest-1182883598 None] Lock "cinder-ea2c196d-67f8-4997-ada0-89fe79a3e015-delete_volume" released by "delete_volume" :: held 3.231s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:50 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_23tghm77" returned: 1 in 0.861s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_23tghm77' failed. Not Retrying. {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:06:50 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8111ef9-1607-4055-bd6c-4d93ceb15289]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ggnazu9odevstack@QuobyteHD {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:50 devstack sudo[86652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ggnazu9odevstack@QuobyteHD Feb 27 02:06:50 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:51 devstack sudo[86647]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ebi60en2devstack@QuobyteHD /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812" returned: 0 in 1.975s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:51 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ebi60en2devstack@QuobyteHD, size 112.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 {{(pid=82738) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:06:51 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Converted 112.00 MB image at 56.57 MB/s Feb 27 02:06:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:51 devstack sudo[86671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 1G Feb 27 02:06:51 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:51 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ggnazu9odevstack@QuobyteHD" returned: 0 in 1.481s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:51 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] 4b706c9e-6966-424a-b9ee-45ddbab3a331 was qcow2, converting to raw {{(pid=82738) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 02:06:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ggnazu9odevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:51 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ggnazu9odevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b Feb 27 02:06:51 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:52 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 1G" returned: 0 in 0.865s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:52 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8db1dc7-21c9-4c19-84f3-7c00f36b9b96]: (4, 'raw') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:52 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 Feb 27 02:06:52 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:UPDATE=115,cinder:SELECT=93,cinder:DELETE=10,cinder:INSERT=44 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Flow 'volume_create_manager' (97882416-8266-4ad1-ba16-85a493072eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c709303-9b8a-4115-ad47-e8622cdda7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c709303-9b8a-4115-ad47-e8622cdda7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1455561269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a97c4833-e856-4264-91c4-92e1e3d0f616,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b731e4f75694a3aaa11f4c22c16c590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:53Z,use_quota=True,user_id='8384d6ce44e64c4b94fa949ce65b3a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b786fa-1676-4ab0-a6f1-95570f5b338f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b786fa-1676-4ab0-a6f1-95570f5b338f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:53 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (072ea661-17b3-4172-a912-b31de78a61de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (072ea661-17b3-4172-a912-b31de78a61de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a97c4833-e856-4264-91c4-92e1e3d0f616', 'volume_name': 'volume-a97c4833-e856-4264-91c4-92e1e3d0f616', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa30db9b-c50e-4de2-a743-88ce28c4e800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:53 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa30db9b-c50e-4de2-a743-88ce28c4e800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d953340-ebd6-4504-a1bd-a8146e67b42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:53 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Volume a97c4833-e856-4264-91c4-92e1e3d0f616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a97c4833-e856-4264-91c4-92e1e3d0f616', 'volume_size': 1} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1455561269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a97c4833-e856-4264-91c4-92e1e3d0f616,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b731e4f75694a3aaa11f4c22c16c590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:53Z,use_quota=True,user_id='8384d6ce44e64c4b94fa949ce65b3a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Creating volume a97c4833-e856-4264-91c4-92e1e3d0f616 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:53 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a97c4833-e856-4264-91c4-92e1e3d0f616 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812" returned: 0 in 1.084s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ggnazu9odevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b" returned: 0 in 1.858s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_ggnazu9odevstack@QuobyteHD, size 112.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b {{(pid=82738) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:06:53 devstack cinder-volume[82738]: INFO cinder.image.image_utils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Converted 112.00 MB image at 60.00 MB/s Feb 27 02:06:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:53 devstack sudo[86687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a97c4833-e856-4264-91c4-92e1e3d0f616 1073741824 Feb 27 02:06:53 devstack sudo[86687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:53 devstack sudo[86690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b 1G Feb 27 02:06:53 devstack sudo[86690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:53 devstack sudo[86688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 Feb 27 02:06:53 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:54 devstack sudo[86690]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b 1G" returned: 0 in 0.757s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:54 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bb8429-a2e4-4457-b5fe-f58b87a70346]: (4, 'raw') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:54 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812" returned: 1 in 0.855s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812' failed. Not Retrying. {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:06:54 devstack cinder-volume[82738]: DEBUG cinder.volume.volume_utils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Downloaded image 4b706c9e-6966-424a-b9ee-45ddbab3a331 ((None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}])) to volume 5556ee63-76b7-4c72-bb52-e96cdc3ed812 successfully. {{(pid=82738) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 02:06:54 devstack sudo[86687]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:54 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Temporary image 4b706c9e-6966-424a-b9ee-45ddbab3a331 for user 43e3fec16f3142dea5d0eac1a2576eff is deleted. {{(pid=82738) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 02:06:54 devstack cinder-volume[82738]: DEBUG cinder.volume.volume_utils [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Marking volume 5556ee63-76b7-4c72-bb52-e96cdc3ed812 as bootable. {{(pid=82738) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 02:06:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a97c4833-e856-4264-91c4-92e1e3d0f616 1073741824" returned: 0 in 0.894s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:54 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Copying metadata from image 4b706c9e-6966-424a-b9ee-45ddbab3a331 to 5556ee63-76b7-4c72-bb52-e96cdc3ed812. {{(pid=82738) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 02:06:54 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Creating volume glance metadata for volume 5556ee63-76b7-4c72-bb52-e96cdc3ed812 backed by image 4b706c9e-6966-424a-b9ee-45ddbab3a331 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82738) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 02:06:54 devstack sudo[86702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b Feb 27 02:06:54 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a4f742-59b3-4e23-8a14-65ed9336f4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812', 'volume_size': 1, 'image_id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db1770ccb718417cb73a54677fa92116', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'created_at': datetime.datetime(2026, 2, 27, 0, 57, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b706c9e-6966-424a-b9ee-45ddbab3a331/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80124990-242f-42fb-b152-c36fcba6755d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a97c4833-e856-4264-91c4-92e1e3d0f616 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:54 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Volume volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 (5556ee63-76b7-4c72-bb52-e96cdc3ed812): created successfully Feb 27 02:06:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80124990-242f-42fb-b152-c36fcba6755d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Flow 'volume_create_manager' (631b741f-e4fa-4485-898c-4a072ad8c4ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:54 devstack sudo[86704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a97c4833-e856-4264-91c4-92e1e3d0f616 Feb 27 02:06:54 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:54 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e125d05d-ffb0-4a39-92d3-11d1eb9dee74 tempest-VolumesExtendTest-1566763655 None] Created volume successfully. Feb 27 02:06:54 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b" returned: 0 in 0.620s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:55 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a97c4833-e856-4264-91c4-92e1e3d0f616" returned: 0 in 0.506s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d953340-ebd6-4504-a1bd-a8146e67b42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a97c4833-e856-4264-91c4-92e1e3d0f616', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbcee383-9614-4c47-95b3-6703bc2f6aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:55 devstack sudo[86709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b Feb 27 02:06:55 devstack sudo[86709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:55 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Volume volume-a97c4833-e856-4264-91c4-92e1e3d0f616 (a97c4833-e856-4264-91c4-92e1e3d0f616): created successfully Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbcee383-9614-4c47-95b3-6703bc2f6aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Flow 'volume_create_manager' (97882416-8266-4ad1-ba16-85a493072eb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:55 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-85c2b97b-d4af-4cbb-9cf1-ed8d05159c79 tempest-VolumesGetTest-3739209 None] Created volume successfully. Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9e0af09a-86b5-4b9d-917f-236e33fe075d tempest-VolumesExtendTest-1566763655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9e0af09a-86b5-4b9d-917f-236e33fe075d tempest-VolumesExtendTest-1566763655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[8769e5ad-0010-4372-acb3-585b8282fabd]: (4, 'raw') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9e0af09a-86b5-4b9d-917f-236e33fe075d tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:55 devstack sudo[86709]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b" returned: 1 in 0.847s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b' failed. Not Retrying. {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG cinder.volume.volume_utils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Downloaded image 4b706c9e-6966-424a-b9ee-45ddbab3a331 ((None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}])) to volume 66ff9307-1fe5-467d-97d0-c55efc019f7b successfully. {{(pid=82738) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Temporary image 4b706c9e-6966-424a-b9ee-45ddbab3a331 for user a872712bbdfe46de983fba404eeda58d is deleted. {{(pid=82738) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG cinder.volume.volume_utils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Marking volume 66ff9307-1fe5-467d-97d0-c55efc019f7b as bootable. {{(pid=82738) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 02:06:55 devstack sudo[86714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 Feb 27 02:06:55 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Copying metadata from image 4b706c9e-6966-424a-b9ee-45ddbab3a331 to 66ff9307-1fe5-467d-97d0-c55efc019f7b. {{(pid=82738) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Creating volume glance metadata for volume 66ff9307-1fe5-467d-97d0-c55efc019f7b backed by image 4b706c9e-6966-424a-b9ee-45ddbab3a331 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82738) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ecaa91-88b0-481e-bb33-adf5cbe9e695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66ff9307-1fe5-467d-97d0-c55efc019f7b', 'volume_size': 1, 'image_id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db1770ccb718417cb73a54677fa92116', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'created_at': datetime.datetime(2026, 2, 27, 0, 57, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b706c9e-6966-424a-b9ee-45ddbab3a331/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa4c27c-559b-4284-b30c-ba32ac208d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:55 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Volume volume-66ff9307-1fe5-467d-97d0-c55efc019f7b (66ff9307-1fe5-467d-97d0-c55efc019f7b): created successfully Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa4c27c-559b-4284-b30c-ba32ac208d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Flow 'volume_create_manager' (1870c611-6706-427a-aaed-789c50b29d6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:55 devstack cinder-volume[82738]: INFO cinder.volume.manager [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-58adc3e0-6b97-44ea-9258-ae2cf6c79967 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Created volume successfully. Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Flow 'volume_create_manager' (bf70c837-867a-4b5b-9015-e2d2c98442c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03eef81f-dbb7-47f7-bc29-86b1bc8edd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03eef81f-dbb7-47f7-bc29-86b1bc8edd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1097080538',display_name='tempest-VolumesGetTest-Volume-1975665764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b71d848-7d4e-4094-bd05-966eddb08e85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b731e4f75694a3aaa11f4c22c16c590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:56Z,use_quota=True,user_id='8384d6ce44e64c4b94fa949ce65b3a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c4d192-6fd6-4cf6-8f24-1d15df5d17f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c4d192-6fd6-4cf6-8f24-1d15df5d17f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c413071f-d422-4fb6-9d32-89985c1cfdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c413071f-d422-4fb6-9d32-89985c1cfdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b71d848-7d4e-4094-bd05-966eddb08e85', 'volume_name': 'volume-3b71d848-7d4e-4094-bd05-966eddb08e85', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434f050a-8f73-4eae-9295-c011e86f6265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434f050a-8f73-4eae-9295-c011e86f6265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911d17f2-631a-4152-8ddf-b5fd417557c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:56 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Volume 3b71d848-7d4e-4094-bd05-966eddb08e85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b71d848-7d4e-4094-bd05-966eddb08e85', 'volume_size': 1} Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:56 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9e0af09a-86b5-4b9d-917f-236e33fe075d tempest-VolumesExtendTest-1566763655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812" returned: 0 in 0.608s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9e0af09a-86b5-4b9d-917f-236e33fe075d tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:56 devstack sudo[86718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 Feb 27 02:06:56 devstack sudo[86718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:56 devstack sudo[86718]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9e0af09a-86b5-4b9d-917f-236e33fe075d tempest-VolumesExtendTest-1566763655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812" returned: 1 in 0.589s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9e0af09a-86b5-4b9d-917f-236e33fe075d tempest-VolumesExtendTest-1566763655 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812' failed. Not Retrying. {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9e0af09a-86b5-4b9d-917f-236e33fe075d tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 2G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9e0af09a-86b5-4b9d-917f-236e33fe075d tempest-VolumesExtendTest-1566763655 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 2G" returned: 0 in 0.047s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9e0af09a-86b5-4b9d-917f-236e33fe075d tempest-VolumesExtendTest-1566763655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.296s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.784s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1097080538',display_name='tempest-VolumesGetTest-Volume-1975665764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b71d848-7d4e-4094-bd05-966eddb08e85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b731e4f75694a3aaa11f4c22c16c590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:56Z,use_quota=True,user_id='8384d6ce44e64c4b94fa949ce65b3a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Creating volume 3b71d848-7d4e-4094-bd05-966eddb08e85 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:57 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3b71d848-7d4e-4094-bd05-966eddb08e85 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:57 devstack sudo[86726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3b71d848-7d4e-4094-bd05-966eddb08e85 1073741824 Feb 27 02:06:57 devstack sudo[86726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:57 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-9e0af09a-86b5-4b9d-917f-236e33fe075d tempest-VolumesExtendTest-1566763655 None] Extend volume completed successfully. Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Flow 'volume_create_manager' (010c7b22-6800-4b9d-9820-e52c2fe9ee25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a24cde-986e-46fc-ac47-40d7d5dd4ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a24cde-986e-46fc-ac47-40d7d5dd4ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1707619057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0cf97d9-8516-4a11-ae0e-e045038d3f5a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='595e13ba430844459c9a1bdae9bdf0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:57Z,use_quota=True,user_id='91fee9001d564c3696f7633428ee7971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61a610a-c1b1-4e8f-94dd-0267d12ef90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61a610a-c1b1-4e8f-94dd-0267d12ef90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df390af3-15c9-4097-b4af-df6eefc93178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df390af3-15c9-4097-b4af-df6eefc93178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0cf97d9-8516-4a11-ae0e-e045038d3f5a', 'volume_name': 'volume-a0cf97d9-8516-4a11-ae0e-e045038d3f5a', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e726c9e-8e7d-461b-be4f-154898a86eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e726c9e-8e7d-461b-be4f-154898a86eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f9dee04-ab5a-448d-a877-fbec674e75ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:57 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Volume a0cf97d9-8516-4a11-ae0e-e045038d3f5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0cf97d9-8516-4a11-ae0e-e045038d3f5a', 'volume_size': 1} Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-bd7a26b4-59bf-4800-a915-e96ee53f1d5f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:57 devstack sudo[86726]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3b71d848-7d4e-4094-bd05-966eddb08e85 1073741824" returned: 0 in 0.597s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3b71d848-7d4e-4094-bd05-966eddb08e85 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:57 devstack sudo[86739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3b71d848-7d4e-4094-bd05-966eddb08e85 Feb 27 02:06:57 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] Acquiring lock "cinder-5556ee63-76b7-4c72-bb52-e96cdc3ed812-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:57 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] Lock "cinder-5556ee63-76b7-4c72-bb52-e96cdc3ed812-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] Acquiring lock "cinder-quobyte-5556ee63-76b7-4c72-bb52-e96cdc3ed812" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] Lock "cinder-quobyte-5556ee63-76b7-4c72-bb52-e96cdc3ed812" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fba30d-6657-4bc4-b4a2-94a8a39ca426]: (4, 'raw') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:58 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3b71d848-7d4e-4094-bd05-966eddb08e85" returned: 0 in 0.507s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.722s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1707619057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0cf97d9-8516-4a11-ae0e-e045038d3f5a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='595e13ba430844459c9a1bdae9bdf0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:57Z,use_quota=True,user_id='91fee9001d564c3696f7633428ee7971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Creating volume a0cf97d9-8516-4a11-ae0e-e045038d3f5a {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:58 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a0cf97d9-8516-4a11-ae0e-e045038d3f5a 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:58 devstack sudo[86743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a0cf97d9-8516-4a11-ae0e-e045038d3f5a 1073741824 Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911d17f2-631a-4152-8ddf-b5fd417557c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b71d848-7d4e-4094-bd05-966eddb08e85', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:58 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:58 devstack sudo[86742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 Feb 27 02:06:58 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (212bd3ab-40fe-4661-98e8-f0110dfb8255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:58 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Volume volume-3b71d848-7d4e-4094-bd05-966eddb08e85 (3b71d848-7d4e-4094-bd05-966eddb08e85): created successfully Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (212bd3ab-40fe-4661-98e8-f0110dfb8255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Flow 'volume_create_manager' (bf70c837-867a-4b5b-9015-e2d2c98442c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:58 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-12897d5e-e457-436b-8e79-fec0e015797f tempest-VolumesGetTest-3739209 None] Created volume successfully. Feb 27 02:06:58 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812" returned: 0 in 0.530s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:58 devstack sudo[86751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 Feb 27 02:06:58 devstack sudo[86751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:58 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a0cf97d9-8516-4a11-ae0e-e045038d3f5a 1073741824" returned: 0 in 0.596s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a0cf97d9-8516-4a11-ae0e-e045038d3f5a {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:58 devstack sudo[86753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a0cf97d9-8516-4a11-ae0e-e045038d3f5a Feb 27 02:06:58 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:59 devstack sudo[86751]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812" returned: 1 in 0.577s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812' failed. Not Retrying. {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:59 devstack sudo[86759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812 Feb 27 02:06:59 devstack sudo[86759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:59 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a0cf97d9-8516-4a11-ae0e-e045038d3f5a" returned: 0 in 0.514s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-bd7a26b4-59bf-4800-a915-e96ee53f1d5f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.859s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f9dee04-ab5a-448d-a877-fbec674e75ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0cf97d9-8516-4a11-ae0e-e045038d3f5a', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cb2210-5faf-420f-baea-65af23908f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:59 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Volume volume-a0cf97d9-8516-4a11-ae0e-e045038d3f5a (a0cf97d9-8516-4a11-ae0e-e045038d3f5a): created successfully Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cb2210-5faf-420f-baea-65af23908f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Flow 'volume_create_manager' (010c7b22-6800-4b9d-9820-e52c2fe9ee25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71ba9dd-8ae6-4a25-8f74-ff59a9f5603a]: (4, 'raw') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-bd7a26b4-59bf-4800-a915-e96ee53f1d5f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:59 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-17ad79ab-5fdd-4d0a-8ed6-abb5d320a3df tempest-VolumesListTestJSON-378591910 None] Created volume successfully. Feb 27 02:06:59 devstack sudo[86761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b Feb 27 02:06:59 devstack sudo[86761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1a66eeae-1cbd-4a9b-8d1b-750bb126c6c4 tempest-VolumesGetTest-3739209 None] Acquiring lock "cinder-3b71d848-7d4e-4094-bd05-966eddb08e85-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1a66eeae-1cbd-4a9b-8d1b-750bb126c6c4 tempest-VolumesGetTest-3739209 None] Lock "cinder-3b71d848-7d4e-4094-bd05-966eddb08e85-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1a66eeae-1cbd-4a9b-8d1b-750bb126c6c4 tempest-VolumesGetTest-3739209 None] Acquiring lock "cinder-quobyte-3b71d848-7d4e-4094-bd05-966eddb08e85" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1a66eeae-1cbd-4a9b-8d1b-750bb126c6c4 tempest-VolumesGetTest-3739209 None] Lock "cinder-quobyte-3b71d848-7d4e-4094-bd05-966eddb08e85" acquired by "delete_volume" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[58808c64-0204-48a6-a674-ebb8ba14abeb]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1a66eeae-1cbd-4a9b-8d1b-750bb126c6c4 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3b71d848-7d4e-4094-bd05-966eddb08e85 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:59 devstack sudo[86763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3b71d848-7d4e-4094-bd05-966eddb08e85 Feb 27 02:06:59 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:59 devstack sudo[86759]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5556ee63-76b7-4c72-bb52-e96cdc3ed812" returned: 0 in 0.613s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] Lock "cinder-quobyte-5556ee63-76b7-4c72-bb52-e96cdc3ed812" released by "delete_volume" :: held 1.768s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:59 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] Created reservations ['e2291355-bec2-49b3-bcf9-e6697d0bf7d2', '301da81a-7530-4b56-9a01-f915fb368d04', '9f8cf4d3-6bd1-4cb0-86c2-e4e28390146b', 'e96c723e-d014-4965-beca-a8e7642a2fd2'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Flow 'volume_create_manager' (2ecb8b45-a9b4-4669-9b06-110b67123740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047edc2d-dc2d-4c34-824e-69a1cec9f702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:00 devstack sudo[86761]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047edc2d-dc2d-4c34-824e-69a1cec9f702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-632239319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='595e13ba430844459c9a1bdae9bdf0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:00Z,use_quota=True,user_id='91fee9001d564c3696f7633428ee7971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903f7c18-d89c-4a03-9aa8-8a4bebbf2ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903f7c18-d89c-4a03-9aa8-8a4bebbf2ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3621cf92-53d1-464e-836a-cf3b6f928fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3621cf92-53d1-464e-836a-cf3b6f928fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2', 'volume_name': 'volume-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab12040f-2821-4e32-9455-3a061385be13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab12040f-2821-4e32-9455-3a061385be13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af75eddd-c76e-4842-b452-23c4a900116d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:00 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Volume cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2', 'volume_size': 1} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-bd7a26b4-59bf-4800-a915-e96ee53f1d5f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b" returned: 0 in 0.755s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-bd7a26b4-59bf-4800-a915-e96ee53f1d5f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:00 devstack sudo[86770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:07:00 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:00 devstack sudo[86768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b Feb 27 02:07:00 devstack sudo[86768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:00 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1a66eeae-1cbd-4a9b-8d1b-750bb126c6c4 tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3b71d848-7d4e-4094-bd05-966eddb08e85" returned: 0 in 0.718s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1a66eeae-1cbd-4a9b-8d1b-750bb126c6c4 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3b71d848-7d4e-4094-bd05-966eddb08e85 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:00 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3b71d848-7d4e-4094-bd05-966eddb08e85 Feb 27 02:07:00 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Flow 'volume_create_manager' (d268bd6b-91e2-4a4f-9b37-02bd17e71ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5b58fd-a3d2-4d56-80b1-559dcde75675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5b58fd-a3d2-4d56-80b1-559dcde75675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-773035463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9df594-3084-440a-86d5-83b5e56ead16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f005938afb84369b3b5ef0463db6d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:01Z,use_quota=True,user_id='43e3fec16f3142dea5d0eac1a2576eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7701a03d-a86f-45ab-82dd-b42f3aa45daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7701a03d-a86f-45ab-82dd-b42f3aa45daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814e1d52-8eef-4f79-b1f3-165ffe1d676a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814e1d52-8eef-4f79-b1f3-165ffe1d676a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d9df594-3084-440a-86d5-83b5e56ead16', 'volume_name': 'volume-5d9df594-3084-440a-86d5-83b5e56ead16', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0086b0da-ca33-4a03-a2b6-ef8f1c4ed6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0086b0da-ca33-4a03-a2b6-ef8f1c4ed6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c2425e4-fcf1-45db-8d0f-af6e51f1cbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:00 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Volume 5d9df594-3084-440a-86d5-83b5e56ead16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d9df594-3084-440a-86d5-83b5e56ead16', 'volume_size': 1} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:00 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:00 devstack sudo[86768]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.687s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-bd7a26b4-59bf-4800-a915-e96ee53f1d5f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b" returned: 1 in 0.753s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-bd7a26b4-59bf-4800-a915-e96ee53f1d5f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b' failed. Not Retrying. {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-bd7a26b4-59bf-4800-a915-e96ee53f1d5f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.554s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.763s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-632239319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='595e13ba430844459c9a1bdae9bdf0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:00Z,use_quota=True,user_id='91fee9001d564c3696f7633428ee7971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Creating volume cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:00 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:00 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] Deleted volume successfully. Feb 27 02:07:00 devstack sudo[86783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2 1073741824 Feb 27 02:07:00 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:00 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f4bbfbf2-fc23-4f8b-ac93-89fb1b029ac1 tempest-VolumesExtendTest-1566763655 None] Lock "cinder-5556ee63-76b7-4c72-bb52-e96cdc3ed812-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1a66eeae-1cbd-4a9b-8d1b-750bb126c6c4 tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3b71d848-7d4e-4094-bd05-966eddb08e85" returned: 0 in 0.606s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-bd7a26b4-59bf-4800-a915-e96ee53f1d5f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf', 'name': 'volume-66ff9307-1fe5-467d-97d0-c55efc019f7b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a47d697-3c96-4f74-bd74-b0e207933b05', 'enforce_multipath': True} {{(pid=82738) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 02:07:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1a66eeae-1cbd-4a9b-8d1b-750bb126c6c4 tempest-VolumesGetTest-3739209 None] Lock "cinder-quobyte-3b71d848-7d4e-4094-bd05-966eddb08e85" released by "delete_volume" :: held 1.383s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:01 devstack cinder-volume[82738]: INFO cinder.volume.manager [req-be0b2eeb-dd1f-4762-ba0a-7a64f9176b1c req-bd7a26b4-59bf-4800-a915-e96ee53f1d5f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] attachment_update completed successfully. Feb 27 02:07:01 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-1a66eeae-1cbd-4a9b-8d1b-750bb126c6c4 tempest-VolumesGetTest-3739209 None] Created reservations ['53f1a3c5-0672-44f7-94d6-03286f9ef76c', '3af72594-aadc-40da-b2d6-3521faba33b1', '3de8fa32-357d-4af2-942a-c3116a0a1f3f', '2edbee69-e4b0-4259-bc59-b5ac176a8d37'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1a66eeae-1cbd-4a9b-8d1b-750bb126c6c4 tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1a66eeae-1cbd-4a9b-8d1b-750bb126c6c4 tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1a66eeae-1cbd-4a9b-8d1b-750bb126c6c4 tempest-VolumesGetTest-3739209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1a66eeae-1cbd-4a9b-8d1b-750bb126c6c4 tempest-VolumesGetTest-3739209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1a66eeae-1cbd-4a9b-8d1b-750bb126c6c4 tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1a66eeae-1cbd-4a9b-8d1b-750bb126c6c4 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:01 devstack sudo[86785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:07:01 devstack sudo[86785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:01 devstack sudo[86785]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1a66eeae-1cbd-4a9b-8d1b-750bb126c6c4 tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.531s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:01 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-1a66eeae-1cbd-4a9b-8d1b-750bb126c6c4 tempest-VolumesGetTest-3739209 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:01 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-1a66eeae-1cbd-4a9b-8d1b-750bb126c6c4 tempest-VolumesGetTest-3739209 None] Deleted volume successfully. Feb 27 02:07:01 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:01 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1a66eeae-1cbd-4a9b-8d1b-750bb126c6c4 tempest-VolumesGetTest-3739209 None] Lock "cinder-3b71d848-7d4e-4094-bd05-966eddb08e85-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2 1073741824" returned: 0 in 0.775s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:01 devstack sudo[86791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2 Feb 27 02:07:01 devstack sudo[86791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-3a7d21e1-a64a-427e-b609-c8469150f914 tempest-VolumesGetTest-3739209 None] Acquiring lock "cinder-a97c4833-e856-4264-91c4-92e1e3d0f616-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-3a7d21e1-a64a-427e-b609-c8469150f914 tempest-VolumesGetTest-3739209 None] Lock "cinder-a97c4833-e856-4264-91c4-92e1e3d0f616-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-3a7d21e1-a64a-427e-b609-c8469150f914 tempest-VolumesGetTest-3739209 None] Acquiring lock "cinder-quobyte-a97c4833-e856-4264-91c4-92e1e3d0f616" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-3a7d21e1-a64a-427e-b609-c8469150f914 tempest-VolumesGetTest-3739209 None] Lock "cinder-quobyte-a97c4833-e856-4264-91c4-92e1e3d0f616" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[4657bdc1-46b1-428a-bfed-d878c371d091]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3a7d21e1-a64a-427e-b609-c8469150f914 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a97c4833-e856-4264-91c4-92e1e3d0f616 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:02 devstack sudo[86791]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2" returned: 0 in 0.523s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.458s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-773035463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9df594-3084-440a-86d5-83b5e56ead16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f005938afb84369b3b5ef0463db6d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:01Z,use_quota=True,user_id='43e3fec16f3142dea5d0eac1a2576eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Creating volume 5d9df594-3084-440a-86d5-83b5e56ead16 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:02 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af75eddd-c76e-4842-b452-23c4a900116d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e9b17d-f701-40b6-afe8-a144c88dc8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:02 devstack sudo[86795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16 1073741824 Feb 27 02:07:02 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:02 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Volume volume-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2 (cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2): created successfully Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e9b17d-f701-40b6-afe8-a144c88dc8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Flow 'volume_create_manager' (2ecb8b45-a9b4-4669-9b06-110b67123740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:02 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-91501441-73c4-493c-a39b-f50b5c453799 tempest-VolumesListTestJSON-378591910 None] Created volume successfully. Feb 27 02:07:02 devstack sudo[86794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a97c4833-e856-4264-91c4-92e1e3d0f616 Feb 27 02:07:02 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:02 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3a7d21e1-a64a-427e-b609-c8469150f914 tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a97c4833-e856-4264-91c4-92e1e3d0f616" returned: 0 in 0.574s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3a7d21e1-a64a-427e-b609-c8469150f914 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a97c4833-e856-4264-91c4-92e1e3d0f616 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:02 devstack sudo[86804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a97c4833-e856-4264-91c4-92e1e3d0f616 Feb 27 02:07:02 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:02 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16 1073741824" returned: 0 in 0.652s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=127,cinder:INSERT=36,cinder:UPDATE=160,cinder:DELETE=15 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:07:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:02 devstack sudo[86806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16 Feb 27 02:07:02 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:03 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3a7d21e1-a64a-427e-b609-c8469150f914 tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a97c4833-e856-4264-91c4-92e1e3d0f616" returned: 0 in 0.559s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-3a7d21e1-a64a-427e-b609-c8469150f914 tempest-VolumesGetTest-3739209 None] Lock "cinder-quobyte-a97c4833-e856-4264-91c4-92e1e3d0f616" released by "delete_volume" :: held 1.177s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-3a7d21e1-a64a-427e-b609-c8469150f914 tempest-VolumesGetTest-3739209 None] Created reservations ['c4010455-e184-4e71-8de8-8047d624f894', 'fb4b36b5-22bd-46ff-8be8-b53193c3aa20', 'fd1615fb-1d54-47c8-ae1d-945d34b8f5d2', '3874c573-69cf-43da-b2a3-1d33165d9e66'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3a7d21e1-a64a-427e-b609-c8469150f914 tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3a7d21e1-a64a-427e-b609-c8469150f914 tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3a7d21e1-a64a-427e-b609-c8469150f914 tempest-VolumesGetTest-3739209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3a7d21e1-a64a-427e-b609-c8469150f914 tempest-VolumesGetTest-3739209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3a7d21e1-a64a-427e-b609-c8469150f914 tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3a7d21e1-a64a-427e-b609-c8469150f914 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:03 devstack sudo[86810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:07:03 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:03 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16" returned: 0 in 0.608s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c2425e4-fcf1-45db-8d0f-af6e51f1cbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d9df594-3084-440a-86d5-83b5e56ead16', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8972d61-6e82-451d-9670-ecd7660dd792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:03 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Volume volume-5d9df594-3084-440a-86d5-83b5e56ead16 (5d9df594-3084-440a-86d5-83b5e56ead16): created successfully Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8972d61-6e82-451d-9670-ecd7660dd792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Flow 'volume_create_manager' (d268bd6b-91e2-4a4f-9b37-02bd17e71ff6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:03 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-4cf604a0-21d7-459c-abaa-3dd58f48b93e tempest-VolumesExtendTest-1566763655 None] Created volume successfully. Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Flow 'volume_create_manager' (7e736ae1-6211-4b95-92c0-8604195951c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2373fcd1-bad3-4937-bd55-8d35ecc73ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2373fcd1-bad3-4937-bd55-8d35ecc73ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-66011774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7fe1684-4536-41cc-963b-c358f7c4f453,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='595e13ba430844459c9a1bdae9bdf0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:04Z,use_quota=True,user_id='91fee9001d564c3696f7633428ee7971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c047381-2008-476d-987c-b42f09cf789b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c047381-2008-476d-987c-b42f09cf789b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4edda3-cf68-45a7-9f55-25b9730bd44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4edda3-cf68-45a7-9f55-25b9730bd44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7fe1684-4536-41cc-963b-c358f7c4f453', 'volume_name': 'volume-a7fe1684-4536-41cc-963b-c358f7c4f453', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d072212-799f-45a6-a726-6df241b02c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d072212-799f-45a6-a726-6df241b02c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8690a37a-9db8-4f57-bb7e-926885b3c66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:03 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Volume a7fe1684-4536-41cc-963b-c358f7c4f453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7fe1684-4536-41cc-963b-c358f7c4f453', 'volume_size': 1} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-66011774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7fe1684-4536-41cc-963b-c358f7c4f453,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='595e13ba430844459c9a1bdae9bdf0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:04Z,use_quota=True,user_id='91fee9001d564c3696f7633428ee7971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Creating volume a7fe1684-4536-41cc-963b-c358f7c4f453 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:03 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a7fe1684-4536-41cc-963b-c358f7c4f453 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:03 devstack sudo[86812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a7fe1684-4536-41cc-963b-c358f7c4f453 1073741824 Feb 27 02:07:03 devstack sudo[86812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:03 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3a7d21e1-a64a-427e-b609-c8469150f914 tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.542s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:03 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-3a7d21e1-a64a-427e-b609-c8469150f914 tempest-VolumesGetTest-3739209 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:04 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-3a7d21e1-a64a-427e-b609-c8469150f914 tempest-VolumesGetTest-3739209 None] Deleted volume successfully. Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-3a7d21e1-a64a-427e-b609-c8469150f914 tempest-VolumesGetTest-3739209 None] Lock "cinder-a97c4833-e856-4264-91c4-92e1e3d0f616-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7e537356-3a8a-47a9-be24-f1d0cb36359e tempest-VolumesExtendTest-1566763655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:04 devstack sudo[86812]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a7fe1684-4536-41cc-963b-c358f7c4f453 1073741824" returned: 0 in 0.705s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a7fe1684-4536-41cc-963b-c358f7c4f453 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:04 devstack sudo[86821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a7fe1684-4536-41cc-963b-c358f7c4f453 Feb 27 02:07:04 devstack sudo[86821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Flow 'volume_create_manager' (3199e1be-9fea-4a18-8f0e-eb66e5764c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c194f8f-6b3b-4b56-a4de-d9b21d68b6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c194f8f-6b3b-4b56-a4de-d9b21d68b6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1994013492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33eb6e43-be1f-47a1-b967-3b7c19ba87a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b731e4f75694a3aaa11f4c22c16c590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:05Z,use_quota=True,user_id='8384d6ce44e64c4b94fa949ce65b3a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1950b66c-6324-4aa8-8c81-a07ec7387c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1950b66c-6324-4aa8-8c81-a07ec7387c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81dfbaaf-ff18-40ce-89b4-3bd390d9a502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81dfbaaf-ff18-40ce-89b4-3bd390d9a502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33eb6e43-be1f-47a1-b967-3b7c19ba87a4', 'volume_name': 'volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1e8305-2969-4e4e-9e73-0f7c9c2f5da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1e8305-2969-4e4e-9e73-0f7c9c2f5da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d7c84e-2d10-4a65-909f-6652bbf2c53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:04 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Volume 33eb6e43-be1f-47a1-b967-3b7c19ba87a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4', 'volume_size': 1} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:04 devstack sudo[86821]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a7fe1684-4536-41cc-963b-c358f7c4f453" returned: 0 in 0.491s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7e537356-3a8a-47a9-be24-f1d0cb36359e tempest-VolumesExtendTest-1566763655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.740s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8690a37a-9db8-4f57-bb7e-926885b3c66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7fe1684-4536-41cc-963b-c358f7c4f453', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ae455b-bdcf-41d5-a298-f72ea788f55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-7e537356-3a8a-47a9-be24-f1d0cb36359e tempest-VolumesExtendTest-1566763655 None] Creating offline snapshot 009c0371-149d-4fa4-b3e2-946b0ab13c59 of volume 5d9df594-3084-440a-86d5-83b5e56ead16 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:04 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Volume volume-a7fe1684-4536-41cc-963b-c358f7c4f453 (a7fe1684-4536-41cc-963b-c358f7c4f453): created successfully Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ae455b-bdcf-41d5-a298-f72ea788f55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Flow 'volume_create_manager' (7e736ae1-6211-4b95-92c0-8604195951c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[8404b6f7-cd7e-46e9-ba16-31356c284bda]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e537356-3a8a-47a9-be24-f1d0cb36359e tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:04 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-17134647-4f96-4b39-a333-f5f39561f60a tempest-VolumesListTestJSON-378591910 None] Created volume successfully. Feb 27 02:07:05 devstack sudo[86824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16 Feb 27 02:07:05 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:05 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e537356-3a8a-47a9-be24-f1d0cb36359e tempest-VolumesExtendTest-1566763655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16" returned: 0 in 0.669s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e537356-3a8a-47a9-be24-f1d0cb36359e tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:05 devstack sudo[86839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59 1G Feb 27 02:07:05 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:07 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e537356-3a8a-47a9-be24-f1d0cb36359e tempest-VolumesExtendTest-1566763655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59 1G" returned: 0 in 1.555s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e537356-3a8a-47a9-be24-f1d0cb36359e tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d9df594-3084-440a-86d5-83b5e56ead16 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:07 devstack sudo[86872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d9df594-3084-440a-86d5-83b5e56ead16 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59 Feb 27 02:07:07 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:07 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e537356-3a8a-47a9-be24-f1d0cb36359e tempest-VolumesExtendTest-1566763655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d9df594-3084-440a-86d5-83b5e56ead16 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59" returned: 0 in 0.761s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:07 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-7e537356-3a8a-47a9-be24-f1d0cb36359e tempest-VolumesExtendTest-1566763655 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59 is being set with open permissions: ugo+rw Feb 27 02:07:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e537356-3a8a-47a9-be24-f1d0cb36359e tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:07 devstack sudo[86877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59 Feb 27 02:07:07 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:08 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e537356-3a8a-47a9-be24-f1d0cb36359e tempest-VolumesExtendTest-1566763655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59" returned: 0 in 0.846s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e537356-3a8a-47a9-be24-f1d0cb36359e tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:08 devstack sudo[86882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.info Feb 27 02:07:08 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:09 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-82059678-7752-41c9-b1b1-ef7d422cc8a9 tempest-VolumesListTestJSON-378591910 None] Acquiring lock "cinder-a7fe1684-4536-41cc-963b-c358f7c4f453-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:09 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-82059678-7752-41c9-b1b1-ef7d422cc8a9 tempest-VolumesListTestJSON-378591910 None] Lock "cinder-a7fe1684-4536-41cc-963b-c358f7c4f453-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:09 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e537356-3a8a-47a9-be24-f1d0cb36359e tempest-VolumesExtendTest-1566763655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.info" returned: 0 in 0.674s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:09 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-7e537356-3a8a-47a9-be24-f1d0cb36359e tempest-VolumesExtendTest-1566763655 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.info is being set with open permissions: ugo+rw Feb 27 02:07:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e537356-3a8a-47a9-be24-f1d0cb36359e tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:09 devstack sudo[86885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.info Feb 27 02:07:09 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:09 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-82059678-7752-41c9-b1b1-ef7d422cc8a9 tempest-VolumesListTestJSON-378591910 None] Acquiring lock "cinder-quobyte-a7fe1684-4536-41cc-963b-c358f7c4f453" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:09 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-82059678-7752-41c9-b1b1-ef7d422cc8a9 tempest-VolumesListTestJSON-378591910 None] Lock "cinder-quobyte-a7fe1684-4536-41cc-963b-c358f7c4f453" acquired by "delete_volume" :: waited 0.015s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:09 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ac0589-15b8-4714-abca-841aabb31f68]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-82059678-7752-41c9-b1b1-ef7d422cc8a9 tempest-VolumesListTestJSON-378591910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a7fe1684-4536-41cc-963b-c358f7c4f453 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:09 devstack sudo[86887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a7fe1684-4536-41cc-963b-c358f7c4f453 Feb 27 02:07:09 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:10 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e537356-3a8a-47a9-be24-f1d0cb36359e tempest-VolumesExtendTest-1566763655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.info" returned: 0 in 0.676s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7e537356-3a8a-47a9-be24-f1d0cb36359e tempest-VolumesExtendTest-1566763655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.300s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.520s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1994013492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33eb6e43-be1f-47a1-b967-3b7c19ba87a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b731e4f75694a3aaa11f4c22c16c590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:05Z,use_quota=True,user_id='8384d6ce44e64c4b94fa949ce65b3a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Creating volume 33eb6e43-be1f-47a1-b967-3b7c19ba87a4 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:10 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:07:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:10 devstack sudo[86892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 1073741824 Feb 27 02:07:10 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:10 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-7e537356-3a8a-47a9-be24-f1d0cb36359e tempest-VolumesExtendTest-1566763655 None] Create snapshot completed successfully Feb 27 02:07:10 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-82059678-7752-41c9-b1b1-ef7d422cc8a9 tempest-VolumesListTestJSON-378591910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a7fe1684-4536-41cc-963b-c358f7c4f453" returned: 0 in 0.774s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-82059678-7752-41c9-b1b1-ef7d422cc8a9 tempest-VolumesListTestJSON-378591910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a7fe1684-4536-41cc-963b-c358f7c4f453 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:10 devstack sudo[86895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a7fe1684-4536-41cc-963b-c358f7c4f453 Feb 27 02:07:10 devstack sudo[86895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-37facaf4-598d-4e6a-96a9-7c31664f305b tempest-VolumesExtendTest-1566763655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:10 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 1073741824" returned: 0 in 0.710s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:10 devstack sudo[86902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 Feb 27 02:07:10 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:11 devstack sudo[86895]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-82059678-7752-41c9-b1b1-ef7d422cc8a9 tempest-VolumesListTestJSON-378591910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a7fe1684-4536-41cc-963b-c358f7c4f453" returned: 0 in 0.686s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-82059678-7752-41c9-b1b1-ef7d422cc8a9 tempest-VolumesListTestJSON-378591910 None] Lock "cinder-quobyte-a7fe1684-4536-41cc-963b-c358f7c4f453" released by "delete_volume" :: held 1.502s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-82059678-7752-41c9-b1b1-ef7d422cc8a9 tempest-VolumesListTestJSON-378591910 None] Created reservations ['0ad9899a-fe90-4c75-94a8-0e7ec2fe4399', '393b4ee8-db7b-4237-bfd5-73b15be6da53', 'dcf83ca0-e680-4711-8939-2ab89e5010c7', 'f4cb0928-eabb-4615-9ee1-2914f437c884'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-82059678-7752-41c9-b1b1-ef7d422cc8a9 tempest-VolumesListTestJSON-378591910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-82059678-7752-41c9-b1b1-ef7d422cc8a9 tempest-VolumesListTestJSON-378591910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-82059678-7752-41c9-b1b1-ef7d422cc8a9 tempest-VolumesListTestJSON-378591910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-82059678-7752-41c9-b1b1-ef7d422cc8a9 tempest-VolumesListTestJSON-378591910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-82059678-7752-41c9-b1b1-ef7d422cc8a9 tempest-VolumesListTestJSON-378591910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-82059678-7752-41c9-b1b1-ef7d422cc8a9 tempest-VolumesListTestJSON-378591910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:11 devstack sudo[86904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:07:11 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:11 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4" returned: 0 in 0.662s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-37facaf4-598d-4e6a-96a9-7c31664f305b tempest-VolumesExtendTest-1566763655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.063s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d7c84e-2d10-4a65-909f-6652bbf2c53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99374e6-4a0e-4023-869a-2eecdc946e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd44bab-18aa-4680-97ae-dfe73ea0276c]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-37facaf4-598d-4e6a-96a9-7c31664f305b tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:11 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Volume volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 (33eb6e43-be1f-47a1-b967-3b7c19ba87a4): created successfully Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99374e6-4a0e-4023-869a-2eecdc946e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Flow 'volume_create_manager' (3199e1be-9fea-4a18-8f0e-eb66e5764c10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:11 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-21f22b4b-7655-4bbe-836d-5e9bbe38a457 tempest-VolumesGetTest-3739209 None] Created volume successfully. Feb 27 02:07:11 devstack sudo[86907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16 Feb 27 02:07:11 devstack sudo[86907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ffd74033-8d3b-446b-a817-d9b22fb80bcc tempest-VolumesListTestJSON-378591910 None] Acquiring lock "cinder-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ffd74033-8d3b-446b-a817-d9b22fb80bcc tempest-VolumesListTestJSON-378591910 None] Lock "cinder-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ffd74033-8d3b-446b-a817-d9b22fb80bcc tempest-VolumesListTestJSON-378591910 None] Acquiring lock "cinder-quobyte-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ffd74033-8d3b-446b-a817-d9b22fb80bcc tempest-VolumesListTestJSON-378591910 None] Lock "cinder-quobyte-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2" acquired by "delete_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[389123e2-04e5-4bdd-a0e2-cda0e50c842b]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ffd74033-8d3b-446b-a817-d9b22fb80bcc tempest-VolumesListTestJSON-378591910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:11 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-82059678-7752-41c9-b1b1-ef7d422cc8a9 tempest-VolumesListTestJSON-378591910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.628s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:11 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-82059678-7752-41c9-b1b1-ef7d422cc8a9 tempest-VolumesListTestJSON-378591910 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:11 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-82059678-7752-41c9-b1b1-ef7d422cc8a9 tempest-VolumesListTestJSON-378591910 None] Deleted volume successfully. Feb 27 02:07:12 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-82059678-7752-41c9-b1b1-ef7d422cc8a9 tempest-VolumesListTestJSON-378591910 None] Lock "cinder-a7fe1684-4536-41cc-963b-c358f7c4f453-delete_volume" released by "delete_volume" :: held 2.533s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:12 devstack sudo[86910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2 Feb 27 02:07:12 devstack sudo[86910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:12 devstack sudo[86907]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-37facaf4-598d-4e6a-96a9-7c31664f305b tempest-VolumesExtendTest-1566763655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16" returned: 0 in 0.779s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-37facaf4-598d-4e6a-96a9-7c31664f305b tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59 2G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-37facaf4-598d-4e6a-96a9-7c31664f305b tempest-VolumesExtendTest-1566763655 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59 2G" returned: 0 in 0.099s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-37facaf4-598d-4e6a-96a9-7c31664f305b tempest-VolumesExtendTest-1566763655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.914s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:12 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-37facaf4-598d-4e6a-96a9-7c31664f305b tempest-VolumesExtendTest-1566763655 None] Extend volume completed successfully. Feb 27 02:07:12 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:12 devstack sudo[86910]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ffd74033-8d3b-446b-a817-d9b22fb80bcc tempest-VolumesListTestJSON-378591910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2" returned: 0 in 0.997s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ffd74033-8d3b-446b-a817-d9b22fb80bcc tempest-VolumesListTestJSON-378591910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:12 devstack sudo[86921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2 Feb 27 02:07:12 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Flow 'volume_create_manager' (28dfa915-b2ca-40c7-9723-7fa237230c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ca39a6-8f6b-4dbe-9ab7-098817c77b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ca39a6-8f6b-4dbe-9ab7-098817c77b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1994912543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b731e4f75694a3aaa11f4c22c16c590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=33eb6e43-be1f-47a1-b967-3b7c19ba87a4,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:13Z,use_quota=True,user_id='8384d6ce44e64c4b94fa949ce65b3a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d81b0d1-cfbc-4eeb-9505-a2bd9a62ed0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d81b0d1-cfbc-4eeb-9505-a2bd9a62ed0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5948ad87-8d17-4b13-83f4-988010dc74f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:12 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] Acquiring lock "cinder-009c0371-149d-4fa4-b3e2-946b0ab13c59-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5948ad87-8d17-4b13-83f4-988010dc74f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb', 'volume_name': 'volume-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb', 'volume_size': 1, 'source_volid': '33eb6e43-be1f-47a1-b967-3b7c19ba87a4', 'source_volstatus': 'available'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (554e4593-00a6-40e7-a268-5d0e064016d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (554e4593-00a6-40e7-a268-5d0e064016d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a6e63c-58b4-4ed4-9877-1ea801f950cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:13 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Volume c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb', 'volume_size': 1, 'source_volid': '33eb6e43-be1f-47a1-b967-3b7c19ba87a4', 'source_volstatus': 'available'} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] Lock "cinder-009c0371-149d-4fa4-b3e2-946b0ab13c59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] Acquiring lock "cinder-quobyte-5d9df594-3084-440a-86d5-83b5e56ead16" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:13 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Cloning volume 33eb6e43-be1f-47a1-b967-3b7c19ba87a4 to volume c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] Lock "cinder-quobyte-5d9df594-3084-440a-86d5-83b5e56ead16" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] Acquiring lock "cinder-quobyte-009c0371-149d-4fa4-b3e2-946b0ab13c59" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Creating offline snapshot 054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6 of volume 33eb6e43-be1f-47a1-b967-3b7c19ba87a4 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] Lock "cinder-quobyte-009c0371-149d-4fa4-b3e2-946b0ab13c59" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] Deleting offline snapshot 009c0371-149d-4fa4-b3e2-946b0ab13c59 of volume 5d9df594-3084-440a-86d5-83b5e56ead16 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] snapshot_file for this snap is: volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0d48e1-0adf-4b81-a0a4-75131f8b4b2e]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[937adbed-40b9-49e7-8604-32302e0a7510]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:13 devstack sudo[86930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 Feb 27 02:07:13 devstack sudo[86930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:13 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59 Feb 27 02:07:13 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:13 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ffd74033-8d3b-446b-a817-d9b22fb80bcc tempest-VolumesListTestJSON-378591910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2" returned: 0 in 0.766s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ffd74033-8d3b-446b-a817-d9b22fb80bcc tempest-VolumesListTestJSON-378591910 None] Lock "cinder-quobyte-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2" released by "delete_volume" :: held 1.791s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-ffd74033-8d3b-446b-a817-d9b22fb80bcc tempest-VolumesListTestJSON-378591910 None] Created reservations ['a1fa7791-42eb-4e34-b457-72aa2c4d07d2', '641f9d08-aa96-486c-8775-16f9367ba63d', 'aa93815c-c84c-46c1-be55-3d79accb622b', '4d18fe6e-b351-4736-8dc8-1d6269fe93f2'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ffd74033-8d3b-446b-a817-d9b22fb80bcc tempest-VolumesListTestJSON-378591910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ffd74033-8d3b-446b-a817-d9b22fb80bcc tempest-VolumesListTestJSON-378591910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ffd74033-8d3b-446b-a817-d9b22fb80bcc tempest-VolumesListTestJSON-378591910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ffd74033-8d3b-446b-a817-d9b22fb80bcc tempest-VolumesListTestJSON-378591910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ffd74033-8d3b-446b-a817-d9b22fb80bcc tempest-VolumesListTestJSON-378591910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ffd74033-8d3b-446b-a817-d9b22fb80bcc tempest-VolumesListTestJSON-378591910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:13 devstack sudo[86960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:07:13 devstack sudo[86960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:13 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59" returned: 0 in 0.753s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d9df594-3084-440a-86d5-83b5e56ead16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a4b333-f61c-4e66-ae9b-d45d897be1d4]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:13 devstack sudo[86930]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4" returned: 0 in 0.816s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:14 devstack sudo[86963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6 1G Feb 27 02:07:14 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:14 devstack sudo[86962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16 Feb 27 02:07:14 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:14 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-403bdac3-0bcc-46b1-8ddf-63f94d87b06d tempest-VolumesListTestJSON-378591910 None] Acquiring lock "cinder-a0cf97d9-8516-4a11-ae0e-e045038d3f5a-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:14 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-403bdac3-0bcc-46b1-8ddf-63f94d87b06d tempest-VolumesListTestJSON-378591910 None] Lock "cinder-a0cf97d9-8516-4a11-ae0e-e045038d3f5a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:14 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-403bdac3-0bcc-46b1-8ddf-63f94d87b06d tempest-VolumesListTestJSON-378591910 None] Acquiring lock "cinder-quobyte-a0cf97d9-8516-4a11-ae0e-e045038d3f5a" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:14 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-403bdac3-0bcc-46b1-8ddf-63f94d87b06d tempest-VolumesListTestJSON-378591910 None] Lock "cinder-quobyte-a0cf97d9-8516-4a11-ae0e-e045038d3f5a" acquired by "delete_volume" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:14 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c78ba9-f2ba-4796-a5ff-4810286a8747]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-403bdac3-0bcc-46b1-8ddf-63f94d87b06d tempest-VolumesListTestJSON-378591910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a0cf97d9-8516-4a11-ae0e-e045038d3f5a {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:14 devstack sudo[86966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a0cf97d9-8516-4a11-ae0e-e045038d3f5a Feb 27 02:07:14 devstack sudo[86966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:14 devstack sudo[86960]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ffd74033-8d3b-446b-a817-d9b22fb80bcc tempest-VolumesListTestJSON-378591910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.750s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:14 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-ffd74033-8d3b-446b-a817-d9b22fb80bcc tempest-VolumesListTestJSON-378591910 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:14 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-ffd74033-8d3b-446b-a817-d9b22fb80bcc tempest-VolumesListTestJSON-378591910 None] Deleted volume successfully. Feb 27 02:07:14 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ffd74033-8d3b-446b-a817-d9b22fb80bcc tempest-VolumesListTestJSON-378591910 None] Lock "cinder-cc6e8c5c-e56f-4b35-85b5-e0d21dac84f2-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:14 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6 1G" returned: 0 in 0.734s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:14 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16" returned: 0 in 0.778s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:14 devstack sudo[86975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6 Feb 27 02:07:14 devstack sudo[86975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:14 devstack sudo[86976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59 Feb 27 02:07:14 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:14 devstack sudo[86966]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-403bdac3-0bcc-46b1-8ddf-63f94d87b06d tempest-VolumesListTestJSON-378591910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a0cf97d9-8516-4a11-ae0e-e045038d3f5a" returned: 0 in 0.684s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-403bdac3-0bcc-46b1-8ddf-63f94d87b06d tempest-VolumesListTestJSON-378591910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a0cf97d9-8516-4a11-ae0e-e045038d3f5a {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:14 devstack sudo[86983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a0cf97d9-8516-4a11-ae0e-e045038d3f5a Feb 27 02:07:14 devstack sudo[86983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:15 devstack sudo[86975]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6" returned: 0 in 0.545s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:15 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6 is being set with open permissions: ugo+rw Feb 27 02:07:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:15 devstack sudo[86998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6 Feb 27 02:07:15 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:15 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59" returned: 0 in 0.785s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:15 devstack sudo[87019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59 Feb 27 02:07:15 devstack sudo[87019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:15 devstack sudo[86983]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-403bdac3-0bcc-46b1-8ddf-63f94d87b06d tempest-VolumesListTestJSON-378591910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a0cf97d9-8516-4a11-ae0e-e045038d3f5a" returned: 0 in 0.639s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-403bdac3-0bcc-46b1-8ddf-63f94d87b06d tempest-VolumesListTestJSON-378591910 None] Lock "cinder-quobyte-a0cf97d9-8516-4a11-ae0e-e045038d3f5a" released by "delete_volume" :: held 1.351s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:15 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-403bdac3-0bcc-46b1-8ddf-63f94d87b06d tempest-VolumesListTestJSON-378591910 None] Created reservations ['6bdeac13-1528-4e62-9338-3434c0aeaa45', '7871c6dd-41e1-4d44-9dbc-252c74ef91f7', '0b128000-f4c6-4d49-bce6-51820ca661b2', '536001b2-7240-46a0-b992-66e7c0d3c347'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-403bdac3-0bcc-46b1-8ddf-63f94d87b06d tempest-VolumesListTestJSON-378591910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-403bdac3-0bcc-46b1-8ddf-63f94d87b06d tempest-VolumesListTestJSON-378591910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-403bdac3-0bcc-46b1-8ddf-63f94d87b06d tempest-VolumesListTestJSON-378591910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-403bdac3-0bcc-46b1-8ddf-63f94d87b06d tempest-VolumesListTestJSON-378591910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-403bdac3-0bcc-46b1-8ddf-63f94d87b06d tempest-VolumesListTestJSON-378591910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-403bdac3-0bcc-46b1-8ddf-63f94d87b06d tempest-VolumesListTestJSON-378591910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:15 devstack sudo[87022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:07:15 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:15 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6" returned: 0 in 0.525s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:15 devstack sudo[87024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.info Feb 27 02:07:15 devstack sudo[87024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:16 devstack sudo[87019]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16.009c0371-149d-4fa4-b3e2-946b0ab13c59" returned: 0 in 0.535s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] Lock "cinder-quobyte-009c0371-149d-4fa4-b3e2-946b0ab13c59" released by "_delete_snapshot" :: held 2.965s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] Lock "cinder-quobyte-5d9df594-3084-440a-86d5-83b5e56ead16" released by "delete_snapshot" :: held 3.018s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] Created reservations ['543c5e40-46d2-4f8e-b60e-6cc127898a87', '523b37c4-c1cc-4681-be0a-5092b4abaab1', '2605e620-469a-4437-924a-959efc0f8184', 'ed6e6d25-5ec0-4f6a-8649-2ead3b831e14'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:16 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] Delete snapshot completed successfully. Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c393b0d8-32cf-4d6a-af7b-b802c4d19422 tempest-VolumesExtendTest-1566763655 None] Lock "cinder-009c0371-149d-4fa4-b3e2-946b0ab13c59-delete_snapshot" released by "delete_snapshot" :: held 3.168s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:16 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-403bdac3-0bcc-46b1-8ddf-63f94d87b06d tempest-VolumesListTestJSON-378591910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.522s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-403bdac3-0bcc-46b1-8ddf-63f94d87b06d tempest-VolumesListTestJSON-378591910 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:16 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-403bdac3-0bcc-46b1-8ddf-63f94d87b06d tempest-VolumesListTestJSON-378591910 None] Deleted volume successfully. Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-403bdac3-0bcc-46b1-8ddf-63f94d87b06d tempest-VolumesListTestJSON-378591910 None] Lock "cinder-a0cf97d9-8516-4a11-ae0e-e045038d3f5a-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:16 devstack sudo[87024]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.info" returned: 0 in 0.500s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:16 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.info is being set with open permissions: ugo+rw Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:16 devstack sudo[87029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.info Feb 27 02:07:16 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:16 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.info" returned: 0 in 0.513s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Acquiring lock "cinder-quobyte-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb" by "_copy_volume_from_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Lock "cinder-quobyte-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] snapshot: 054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6, volume: c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb, {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3f9223-fe2b-4aa8-a15b-610f537f315d]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:16 devstack sudo[87032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6 Feb 27 02:07:16 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:17 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-90c3dbce-1364-4990-86f6-740221b5edd3 tempest-VolumesExtendTest-1566763655 None] Acquiring lock "cinder-5d9df594-3084-440a-86d5-83b5e56ead16-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:17 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-90c3dbce-1364-4990-86f6-740221b5edd3 tempest-VolumesExtendTest-1566763655 None] Lock "cinder-5d9df594-3084-440a-86d5-83b5e56ead16-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:17 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-90c3dbce-1364-4990-86f6-740221b5edd3 tempest-VolumesExtendTest-1566763655 None] Acquiring lock "cinder-quobyte-5d9df594-3084-440a-86d5-83b5e56ead16" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:17 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-90c3dbce-1364-4990-86f6-740221b5edd3 tempest-VolumesExtendTest-1566763655 None] Lock "cinder-quobyte-5d9df594-3084-440a-86d5-83b5e56ead16" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:17 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9ce393-5386-4855-b63a-1fc0c99a970d]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90c3dbce-1364-4990-86f6-740221b5edd3 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:17 devstack sudo[87034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16 Feb 27 02:07:17 devstack sudo[87034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:17 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6" returned: 0 in 0.654s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:17 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:17 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:07:17 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Creating direct copy from snapshot {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:07:17 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[2948922f-1f20-447d-81b9-87ca79a5f892]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:17 devstack sudo[87039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 Feb 27 02:07:17 devstack sudo[87039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:17 devstack sudo[87034]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90c3dbce-1364-4990-86f6-740221b5edd3 tempest-VolumesExtendTest-1566763655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16" returned: 0 in 0.611s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90c3dbce-1364-4990-86f6-740221b5edd3 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:17 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16 Feb 27 02:07:17 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:18 devstack sudo[87039]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4" returned: 0 in 0.682s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG cinder.utils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Path /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb not found in is_blk_device check {{(pid=82738) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:18 devstack sudo[87081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb Feb 27 02:07:18 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:18 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90c3dbce-1364-4990-86f6-740221b5edd3 tempest-VolumesExtendTest-1566763655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5d9df594-3084-440a-86d5-83b5e56ead16" returned: 0 in 0.593s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-90c3dbce-1364-4990-86f6-740221b5edd3 tempest-VolumesExtendTest-1566763655 None] Lock "cinder-quobyte-5d9df594-3084-440a-86d5-83b5e56ead16" released by "delete_volume" :: held 1.265s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-90c3dbce-1364-4990-86f6-740221b5edd3 tempest-VolumesExtendTest-1566763655 None] Created reservations ['e8eedd74-64e3-4a87-a224-4e2f49f05d86', '9408f9f1-b261-4e63-9d77-f1b38f2b50e8', '2a4248eb-8782-45c7-b83b-b5ab5008dbf2', 'd1130fd9-cd26-4b15-8557-bfe55758389b'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Flow 'volume_create_manager' (5a80d975-200d-4ac9-a6a9-660a9fdcec22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde9e11b-e819-4a2f-8227-4bcbded3be7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde9e11b-e819-4a2f-8227-4bcbded3be7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1340900763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107a59fa-234f-4fbe-a7f5-b9c7e2789920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5d815560c046e588550ed8e1e12140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:19Z,use_quota=True,user_id='84d82a13be32473f97eafabceb02ae1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e2a593-9feb-4f2e-8139-907bc34eeb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e2a593-9feb-4f2e-8139-907bc34eeb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c980f3-ec16-4ef9-9778-9fafaf8e6617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c980f3-ec16-4ef9-9778-9fafaf8e6617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '107a59fa-234f-4fbe-a7f5-b9c7e2789920', 'volume_name': 'volume-107a59fa-234f-4fbe-a7f5-b9c7e2789920', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe98a6dd-e93a-4805-a7e5-7b8268fabfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe98a6dd-e93a-4805-a7e5-7b8268fabfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7547caa3-05a6-4385-902d-2ed7a0f1ae01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:18 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Volume 107a59fa-234f-4fbe-a7f5-b9c7e2789920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-107a59fa-234f-4fbe-a7f5-b9c7e2789920', 'volume_size': 1} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-90c3dbce-1364-4990-86f6-740221b5edd3 tempest-VolumesExtendTest-1566763655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-90c3dbce-1364-4990-86f6-740221b5edd3 tempest-VolumesExtendTest-1566763655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-90c3dbce-1364-4990-86f6-740221b5edd3 tempest-VolumesExtendTest-1566763655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-90c3dbce-1364-4990-86f6-740221b5edd3 tempest-VolumesExtendTest-1566763655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-90c3dbce-1364-4990-86f6-740221b5edd3 tempest-VolumesExtendTest-1566763655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90c3dbce-1364-4990-86f6-740221b5edd3 tempest-VolumesExtendTest-1566763655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:18 devstack sudo[87089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:07:18 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:20 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90c3dbce-1364-4990-86f6-740221b5edd3 tempest-VolumesExtendTest-1566763655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 1.385s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:20 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-90c3dbce-1364-4990-86f6-740221b5edd3 tempest-VolumesExtendTest-1566763655 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:20 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-90c3dbce-1364-4990-86f6-740221b5edd3 tempest-VolumesExtendTest-1566763655 None] Deleted volume successfully. Feb 27 02:07:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-90c3dbce-1364-4990-86f6-740221b5edd3 tempest-VolumesExtendTest-1566763655 None] Lock "cinder-5d9df594-3084-440a-86d5-83b5e56ead16-delete_volume" released by "delete_volume" :: held 3.030s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:21 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb" returned: 0 in 3.528s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:21 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea245094-002e-41df-9638-1082db2a24e6]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:21 devstack sudo[87129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 Feb 27 02:07:21 devstack sudo[87129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:22 devstack sudo[87129]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4" returned: 0 in 0.802s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:22 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4, size 1024.00 MB, duration 3.53 sec, destination /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb {{(pid=82738) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:07:22 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Converted 1024.00 MB image at 290.14 MB/s Feb 27 02:07:22 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb is being set with open permissions: ugo+rw Feb 27 02:07:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:22 devstack sudo[87136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb Feb 27 02:07:22 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:23 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb" returned: 0 in 0.638s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:23 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Lock "cinder-quobyte-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb" released by "_copy_volume_from_snapshot" :: held 6.371s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:23 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Acquiring lock "cinder-quobyte-054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:23 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Lock "cinder-quobyte-054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Deleting offline snapshot 054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6 of volume 33eb6e43-be1f-47a1-b967-3b7c19ba87a4 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] snapshot_file for this snap is: volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:23 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af7845b-b58c-4c97-bd1f-d801e41919bb]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:23 devstack sudo[87139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6 Feb 27 02:07:23 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:23 devstack cinder-volume[82738]: DEBUG oslo_service.periodic_task [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82738) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:07:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:23 devstack sudo[87141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:07:23 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:24 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Flow 'volume_create_manager' (f23c8b83-02ba-409f-b564-9585f14a5e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:24 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0691a5f-0c47-40d1-a3fc-190a4ad1924a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6" returned: 0 in 0.888s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:24 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:24 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e19cb62-da1e-4062-b081-21494199f7e4]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0691a5f-0c47-40d1-a3fc-190a4ad1924a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-38161073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88c3daf2-07a1-46bd-8eed-f39cbcabc2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db3410e216fd496fb0866ab38b07a4c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:24Z,use_quota=True,user_id='31851884f1824b33b6de4ca5802a0a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223bf997-779e-4889-9954-6c9ab9efb58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223bf997-779e-4889-9954-6c9ab9efb58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8f49ce-c3eb-494f-9371-848be8f482e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8f49ce-c3eb-494f-9371-848be8f482e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88c3daf2-07a1-46bd-8eed-f39cbcabc2c3', 'volume_name': 'volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4979d160-6d35-4f85-a146-4a9689cb4ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4979d160-6d35-4f85-a146-4a9689cb4ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (740ad8b4-9201-4178-998e-5456d87dcc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:24 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Volume 88c3daf2-07a1-46bd-8eed-f39cbcabc2c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3', 'volume_size': 1} Feb 27 02:07:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:24 devstack sudo[87146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 Feb 27 02:07:24 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:24 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.653s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:24 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:24 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4" returned: 0 in 0.567s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:24 devstack sudo[87152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6 Feb 27 02:07:24 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:25 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6" returned: 0 in 0.606s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:25 devstack sudo[87185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6 Feb 27 02:07:25 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:25 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4.054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6" returned: 0 in 0.556s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Lock "cinder-quobyte-054cc56a-75ed-4b2c-8ca1-a7f5b38dfae6" released by "_delete_snapshot" :: held 2.717s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.951s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.238s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1340900763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107a59fa-234f-4fbe-a7f5-b9c7e2789920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5d815560c046e588550ed8e1e12140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:19Z,use_quota=True,user_id='84d82a13be32473f97eafabceb02ae1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Creating volume 107a59fa-234f-4fbe-a7f5-b9c7e2789920 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:26 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:07:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-107a59fa-234f-4fbe-a7f5-b9c7e2789920 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a6e63c-58b4-4ed4-9877-1ea801f950cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb', 'volume_size': 1, 'source_volid': '33eb6e43-be1f-47a1-b967-3b7c19ba87a4', 'source_volstatus': 'available'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5683ff-70d7-41fd-80a3-dc95ee2b1816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:26 devstack sudo[87209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-107a59fa-234f-4fbe-a7f5-b9c7e2789920 1073741824 Feb 27 02:07:26 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:26 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Volume volume-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb (c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb): created successfully Feb 27 02:07:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5683ff-70d7-41fd-80a3-dc95ee2b1816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Flow 'volume_create_manager' (28dfa915-b2ca-40c7-9723-7fa237230c04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:26 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e4d4f461-07d9-474d-a732-027edc17c3ef tempest-VolumesGetTest-3739209 None] Created volume successfully. Feb 27 02:07:26 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-107a59fa-234f-4fbe-a7f5-b9c7e2789920 1073741824" returned: 0 in 0.704s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-107a59fa-234f-4fbe-a7f5-b9c7e2789920 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:26 devstack sudo[87215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-107a59fa-234f-4fbe-a7f5-b9c7e2789920 Feb 27 02:07:26 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:27 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-107a59fa-234f-4fbe-a7f5-b9c7e2789920" returned: 0 in 0.529s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.066s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-38161073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88c3daf2-07a1-46bd-8eed-f39cbcabc2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db3410e216fd496fb0866ab38b07a4c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:24Z,use_quota=True,user_id='31851884f1824b33b6de4ca5802a0a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Creating volume 88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:27 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:27 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 1073741824 Feb 27 02:07:27 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7547caa3-05a6-4385-902d-2ed7a0f1ae01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-107a59fa-234f-4fbe-a7f5-b9c7e2789920', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320795ef-6d6c-469a-ab09-b258be3930d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:27 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Volume volume-107a59fa-234f-4fbe-a7f5-b9c7e2789920 (107a59fa-234f-4fbe-a7f5-b9c7e2789920): created successfully Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320795ef-6d6c-469a-ab09-b258be3930d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Flow 'volume_create_manager' (5a80d975-200d-4ac9-a6a9-660a9fdcec22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:27 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-512bb36e-06a0-4677-aa72-602634371de1 tempest-VolumesNegativeTest-590141471 None] Created volume successfully. Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Flow 'volume_create_manager' (b0a7bdcc-9258-44e1-bb06-e1390f2acbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b65f465-f110-4820-8452-375310775de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b65f465-f110-4820-8452-375310775de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-667466891',display_name='tempest-VolumesGetTest-Volume-1993483901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3705a026-59c2-4518-9857-9ffb9e5868a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b731e4f75694a3aaa11f4c22c16c590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:28Z,use_quota=True,user_id='8384d6ce44e64c4b94fa949ce65b3a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4841c03-29ec-4691-871f-3f73c734e931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4841c03-29ec-4691-871f-3f73c734e931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde73c2e-4333-42be-b54e-418b1ff647d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde73c2e-4333-42be-b54e-418b1ff647d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3705a026-59c2-4518-9857-9ffb9e5868a4', 'volume_name': 'volume-3705a026-59c2-4518-9857-9ffb9e5868a4', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1ed720-a943-49a3-a9f5-fb40db9f4ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1ed720-a943-49a3-a9f5-fb40db9f4ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e2cd9f-fd4b-4115-ba36-9eee45a1e90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:27 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Volume 3705a026-59c2-4518-9857-9ffb9e5868a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3705a026-59c2-4518-9857-9ffb9e5868a4', 'volume_size': 1} Feb 27 02:07:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:28 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 1073741824" returned: 0 in 0.995s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:28 devstack sudo[87223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 Feb 27 02:07:28 devstack sudo[87223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:28 devstack sudo[87223]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3" returned: 0 in 0.528s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:28 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.857s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:28 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-667466891',display_name='tempest-VolumesGetTest-Volume-1993483901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3705a026-59c2-4518-9857-9ffb9e5868a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b731e4f75694a3aaa11f4c22c16c590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:28Z,use_quota=True,user_id='8384d6ce44e64c4b94fa949ce65b3a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:28 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Creating volume 3705a026-59c2-4518-9857-9ffb9e5868a4 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:28 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:28 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:28 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:28 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:07:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3705a026-59c2-4518-9857-9ffb9e5868a4 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:28 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (740ad8b4-9201-4178-998e-5456d87dcc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:28 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b978d1d-a53d-4d56-b8b5-16028eb19afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:28 devstack sudo[87229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3705a026-59c2-4518-9857-9ffb9e5868a4 1073741824 Feb 27 02:07:28 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:28 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Volume volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 (88c3daf2-07a1-46bd-8eed-f39cbcabc2c3): created successfully Feb 27 02:07:28 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b978d1d-a53d-4d56-b8b5-16028eb19afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:28 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Flow 'volume_create_manager' (f23c8b83-02ba-409f-b564-9585f14a5e1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:28 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-9b0fcbd7-3f6d-4045-8c83-52b0384f7446 tempest-VolumesSnapshotListTestJSON-445713483 None] Created volume successfully. Feb 27 02:07:29 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3705a026-59c2-4518-9857-9ffb9e5868a4 1073741824" returned: 0 in 0.860s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3705a026-59c2-4518-9857-9ffb9e5868a4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:29 devstack sudo[87256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3705a026-59c2-4518-9857-9ffb9e5868a4 Feb 27 02:07:29 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e898711f-641b-4fc2-8d8a-302788dc74cc tempest-VolumesSnapshotListTestJSON-445713483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:30 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3705a026-59c2-4518-9857-9ffb9e5868a4" returned: 0 in 0.466s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:30 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e898711f-641b-4fc2-8d8a-302788dc74cc tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.410s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e2cd9f-fd4b-4115-ba36-9eee45a1e90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3705a026-59c2-4518-9857-9ffb9e5868a4', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55aee71-6985-424d-a238-86394c8dbef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:30 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Volume volume-3705a026-59c2-4518-9857-9ffb9e5868a4 (3705a026-59c2-4518-9857-9ffb9e5868a4): created successfully Feb 27 02:07:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55aee71-6985-424d-a238-86394c8dbef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Flow 'volume_create_manager' (b0a7bdcc-9258-44e1-bb06-e1390f2acbcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:30 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-e898711f-641b-4fc2-8d8a-302788dc74cc tempest-VolumesSnapshotListTestJSON-445713483 None] Creating offline snapshot 3cf28002-a429-47c4-8cdb-d74ed16127c8 of volume 88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:30 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-09514b78-ad94-43ad-bee2-dd551295baf6 tempest-VolumesGetTest-3739209 None] Created volume successfully. Feb 27 02:07:30 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb0c9fd-290d-4f4f-9e4e-6c0df6fea89c]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e898711f-641b-4fc2-8d8a-302788dc74cc tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:30 devstack sudo[87260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 Feb 27 02:07:30 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:31 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e898711f-641b-4fc2-8d8a-302788dc74cc tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3" returned: 0 in 0.724s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e898711f-641b-4fc2-8d8a-302788dc74cc tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:31 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 1G Feb 27 02:07:31 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:31 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8a68af3e-1a55-4a18-8dca-6f8f1765483a tempest-VolumesGetTest-3739209 None] Acquiring lock "cinder-3705a026-59c2-4518-9857-9ffb9e5868a4-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:31 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8a68af3e-1a55-4a18-8dca-6f8f1765483a tempest-VolumesGetTest-3739209 None] Lock "cinder-3705a026-59c2-4518-9857-9ffb9e5868a4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:31 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8a68af3e-1a55-4a18-8dca-6f8f1765483a tempest-VolumesGetTest-3739209 None] Acquiring lock "cinder-quobyte-3705a026-59c2-4518-9857-9ffb9e5868a4" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:31 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8a68af3e-1a55-4a18-8dca-6f8f1765483a tempest-VolumesGetTest-3739209 None] Lock "cinder-quobyte-3705a026-59c2-4518-9857-9ffb9e5868a4" acquired by "delete_volume" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:31 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa90a832-a4c9-447b-9cd8-f5ec55cdb353]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8a68af3e-1a55-4a18-8dca-6f8f1765483a tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3705a026-59c2-4518-9857-9ffb9e5868a4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:31 devstack sudo[87269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3705a026-59c2-4518-9857-9ffb9e5868a4 Feb 27 02:07:31 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:31 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e898711f-641b-4fc2-8d8a-302788dc74cc tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 1G" returned: 0 in 0.699s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e898711f-641b-4fc2-8d8a-302788dc74cc tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:31 devstack sudo[87274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 Feb 27 02:07:31 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:31 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8a68af3e-1a55-4a18-8dca-6f8f1765483a tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3705a026-59c2-4518-9857-9ffb9e5868a4" returned: 0 in 0.682s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8a68af3e-1a55-4a18-8dca-6f8f1765483a tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3705a026-59c2-4518-9857-9ffb9e5868a4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:32 devstack sudo[87279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3705a026-59c2-4518-9857-9ffb9e5868a4 Feb 27 02:07:32 devstack sudo[87279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:32 devstack cinder-volume[82738]: INFO cinder.volume.manager [req-59fed606-5174-422b-a666-3bb05ce33e53 req-b93baf93-cd97-4ad3-9ab8-b924aba44955 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Terminate volume connection completed successfully. Feb 27 02:07:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-59fed606-5174-422b-a666-3bb05ce33e53 req-b93baf93-cd97-4ad3-9ab8-b924aba44955 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Deleting attachment 1a47d697-3c96-4f74-bd74-b0e207933b05. {{(pid=82738) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 02:07:32 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e898711f-641b-4fc2-8d8a-302788dc74cc tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8" returned: 0 in 0.593s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:32 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-e898711f-641b-4fc2-8d8a-302788dc74cc tempest-VolumesSnapshotListTestJSON-445713483 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 is being set with open permissions: ugo+rw Feb 27 02:07:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e898711f-641b-4fc2-8d8a-302788dc74cc tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:32 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 Feb 27 02:07:32 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:32 devstack sudo[87279]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8a68af3e-1a55-4a18-8dca-6f8f1765483a tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3705a026-59c2-4518-9857-9ffb9e5868a4" returned: 0 in 0.561s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:32 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8a68af3e-1a55-4a18-8dca-6f8f1765483a tempest-VolumesGetTest-3739209 None] Lock "cinder-quobyte-3705a026-59c2-4518-9857-9ffb9e5868a4" released by "delete_volume" :: held 1.279s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:32 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-8a68af3e-1a55-4a18-8dca-6f8f1765483a tempest-VolumesGetTest-3739209 None] Created reservations ['db7c6baf-d4c1-47cd-8f70-9d9d6f0f89cf', '7b94b6e5-168f-4e39-ab51-36dfc5725dc2', '958303e7-836a-44d0-b5d6-6e4e36ee1d21', '577d985a-f6e6-4a9f-9ed0-df7f296aa770'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:32 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Acquiring lock "cinder-66ff9307-1fe5-467d-97d0-c55efc019f7b-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:32 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "cinder-66ff9307-1fe5-467d-97d0-c55efc019f7b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:32 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Acquiring lock "cinder-quobyte-66ff9307-1fe5-467d-97d0-c55efc019f7b" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:32 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "cinder-quobyte-66ff9307-1fe5-467d-97d0-c55efc019f7b" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8a68af3e-1a55-4a18-8dca-6f8f1765483a tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8a68af3e-1a55-4a18-8dca-6f8f1765483a tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:32 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8a68af3e-1a55-4a18-8dca-6f8f1765483a tempest-VolumesGetTest-3739209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:32 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8a68af3e-1a55-4a18-8dca-6f8f1765483a tempest-VolumesGetTest-3739209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8a68af3e-1a55-4a18-8dca-6f8f1765483a tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8a68af3e-1a55-4a18-8dca-6f8f1765483a tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:32 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90248df-0d9f-400d-8b83-bc3d910f44e8]: (4, 'raw') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:32 devstack sudo[87288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:07:32 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:32 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e898711f-641b-4fc2-8d8a-302788dc74cc tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8" returned: 0 in 0.507s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e898711f-641b-4fc2-8d8a-302788dc74cc tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:32 devstack sudo[87289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b Feb 27 02:07:32 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:32 devstack sudo[87291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.info Feb 27 02:07:32 devstack sudo[87291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:33 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8a68af3e-1a55-4a18-8dca-6f8f1765483a tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.621s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:33 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-8a68af3e-1a55-4a18-8dca-6f8f1765483a tempest-VolumesGetTest-3739209 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:33 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-8a68af3e-1a55-4a18-8dca-6f8f1765483a tempest-VolumesGetTest-3739209 None] Deleted volume successfully. Feb 27 02:07:33 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8a68af3e-1a55-4a18-8dca-6f8f1765483a tempest-VolumesGetTest-3739209 None] Lock "cinder-3705a026-59c2-4518-9857-9ffb9e5868a4-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:33 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-24da915a-1dc0-4035-8089-57fcc35c1983 tempest-VolumesGetTest-3739209 None] Acquiring lock "cinder-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:33 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-24da915a-1dc0-4035-8089-57fcc35c1983 tempest-VolumesGetTest-3739209 None] Lock "cinder-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:33 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-24da915a-1dc0-4035-8089-57fcc35c1983 tempest-VolumesGetTest-3739209 None] Acquiring lock "cinder-quobyte-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:33 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-24da915a-1dc0-4035-8089-57fcc35c1983 tempest-VolumesGetTest-3739209 None] Lock "cinder-quobyte-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb" acquired by "delete_volume" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:33 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b" returned: 0 in 0.883s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:33 devstack sudo[87291]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:33 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e71c64-d3e7-431f-a149-cb1a0f427e01]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-24da915a-1dc0-4035-8089-57fcc35c1983 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e898711f-641b-4fc2-8d8a-302788dc74cc tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.info" returned: 0 in 0.845s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:33 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-e898711f-641b-4fc2-8d8a-302788dc74cc tempest-VolumesSnapshotListTestJSON-445713483 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.info is being set with open permissions: ugo+rw Feb 27 02:07:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e898711f-641b-4fc2-8d8a-302788dc74cc tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:33 devstack sudo[87300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.info Feb 27 02:07:33 devstack sudo[87300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:33 devstack sudo[87298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b Feb 27 02:07:33 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:33 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb Feb 27 02:07:33 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:34 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b" returned: 1 in 0.738s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b' failed. Not Retrying. {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:07:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:34 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:34 devstack sudo[87300]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-24da915a-1dc0-4035-8089-57fcc35c1983 tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb" returned: 0 in 0.741s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-24da915a-1dc0-4035-8089-57fcc35c1983 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:34 devstack sudo[87311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b Feb 27 02:07:34 devstack sudo[87311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e898711f-641b-4fc2-8d8a-302788dc74cc tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.info" returned: 0 in 0.748s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e898711f-641b-4fc2-8d8a-302788dc74cc tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.226s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:34 devstack sudo[87312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb Feb 27 02:07:34 devstack sudo[87312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:34 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e898711f-641b-4fc2-8d8a-302788dc74cc tempest-VolumesSnapshotListTestJSON-445713483 None] Create snapshot completed successfully Feb 27 02:07:35 devstack sudo[87311]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-66ff9307-1fe5-467d-97d0-c55efc019f7b" returned: 0 in 0.674s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "cinder-quobyte-66ff9307-1fe5-467d-97d0-c55efc019f7b" released by "delete_volume" :: held 2.349s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG cinder.quota [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Created reservations ['5ac9ca84-9bda-48fa-b8b1-5cc907b98bcf', 'fd3ea826-22ec-41e5-93c4-31884de1198c', '3ccf6e5f-f948-423e-95bb-ef5e41011e98', '94a723b5-26d5-4271-aa47-cd3667893dec'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:35 devstack sudo[87312]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-24da915a-1dc0-4035-8089-57fcc35c1983 tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb" returned: 0 in 0.815s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-24da915a-1dc0-4035-8089-57fcc35c1983 tempest-VolumesGetTest-3739209 None] Lock "cinder-quobyte-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb" released by "delete_volume" :: held 1.665s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:35 devstack sudo[87323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f90e634d-7253-4427-9bbe-edb5b0c31110 tempest-VolumesSnapshotListTestJSON-445713483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f90e634d-7253-4427-9bbe-edb5b0c31110 tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:35 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-f90e634d-7253-4427-9bbe-edb5b0c31110 tempest-VolumesSnapshotListTestJSON-445713483 None] Creating offline snapshot a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd of volume 88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d7dcde-a43c-4f13-8840-309cd9f2618d]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f90e634d-7253-4427-9bbe-edb5b0c31110 tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-24da915a-1dc0-4035-8089-57fcc35c1983 tempest-VolumesGetTest-3739209 None] Created reservations ['1e812030-075f-49f7-ab0a-97ac0fb4ec66', '1f4b7ef1-030d-4231-95d8-34cd16ab11ae', '90dda213-555a-4cab-bbcc-e06656311efc', 'c45b1e3c-17ae-4a68-8f06-f2f3712e7acc'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-24da915a-1dc0-4035-8089-57fcc35c1983 tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-24da915a-1dc0-4035-8089-57fcc35c1983 tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-24da915a-1dc0-4035-8089-57fcc35c1983 tempest-VolumesGetTest-3739209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-24da915a-1dc0-4035-8089-57fcc35c1983 tempest-VolumesGetTest-3739209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-24da915a-1dc0-4035-8089-57fcc35c1983 tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-24da915a-1dc0-4035-8089-57fcc35c1983 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:35 devstack sudo[87330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:07:35 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:35 devstack sudo[87329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 Feb 27 02:07:35 devstack sudo[87329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e3467f86-4074-4467-bc66-58b038efde7a tempest-VolumesGetTest-3739209 None] Acquiring lock "cinder-33eb6e43-be1f-47a1-b967-3b7c19ba87a4-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e3467f86-4074-4467-bc66-58b038efde7a tempest-VolumesGetTest-3739209 None] Lock "cinder-33eb6e43-be1f-47a1-b967-3b7c19ba87a4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:36 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e3467f86-4074-4467-bc66-58b038efde7a tempest-VolumesGetTest-3739209 None] Acquiring lock "cinder-quobyte-33eb6e43-be1f-47a1-b967-3b7c19ba87a4" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:36 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e3467f86-4074-4467-bc66-58b038efde7a tempest-VolumesGetTest-3739209 None] Lock "cinder-quobyte-33eb6e43-be1f-47a1-b967-3b7c19ba87a4" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:36 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[859447ac-af05-43bb-8f74-ee5df11a82d4]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e3467f86-4074-4467-bc66-58b038efde7a tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:36 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.770s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:36 devstack cinder-volume[82738]: DEBUG cinder.manager [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:36 devstack cinder-volume[82738]: INFO cinder.volume.manager [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Deleted volume successfully. Feb 27 02:07:36 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-59fed606-5174-422b-a666-3bb05ce33e53 req-1a630d5f-eeb0-4ab1-9927-5b7edd5e3e55 tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "cinder-66ff9307-1fe5-467d-97d0-c55efc019f7b-delete_volume" released by "delete_volume" :: held 3.444s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:36 devstack sudo[87340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 Feb 27 02:07:36 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:36 devstack sudo[87329]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f90e634d-7253-4427-9bbe-edb5b0c31110 tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8" returned: 0 in 0.876s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:36 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-f90e634d-7253-4427-9bbe-edb5b0c31110 tempest-VolumesSnapshotListTestJSON-445713483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f90e634d-7253-4427-9bbe-edb5b0c31110 tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:36 devstack sudo[87346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd 1G Feb 27 02:07:36 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:36 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-24da915a-1dc0-4035-8089-57fcc35c1983 tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.819s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:36 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-24da915a-1dc0-4035-8089-57fcc35c1983 tempest-VolumesGetTest-3739209 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:36 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-24da915a-1dc0-4035-8089-57fcc35c1983 tempest-VolumesGetTest-3739209 None] Deleted volume successfully. Feb 27 02:07:36 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-24da915a-1dc0-4035-8089-57fcc35c1983 tempest-VolumesGetTest-3739209 None] Lock "cinder-c9ffca6a-c3ee-46d5-9237-e5f5509cb0cb-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:36 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e3467f86-4074-4467-bc66-58b038efde7a tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4" returned: 0 in 0.705s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e3467f86-4074-4467-bc66-58b038efde7a tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:36 devstack sudo[87354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4 Feb 27 02:07:36 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:36 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f90e634d-7253-4427-9bbe-edb5b0c31110 tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd 1G" returned: 0 in 0.626s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f90e634d-7253-4427-9bbe-edb5b0c31110 tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:36 devstack sudo[87356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd Feb 27 02:07:36 devstack sudo[87356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:37 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e3467f86-4074-4467-bc66-58b038efde7a tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-33eb6e43-be1f-47a1-b967-3b7c19ba87a4" returned: 0 in 0.510s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:37 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e3467f86-4074-4467-bc66-58b038efde7a tempest-VolumesGetTest-3739209 None] Lock "cinder-quobyte-33eb6e43-be1f-47a1-b967-3b7c19ba87a4" released by "delete_volume" :: held 1.295s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:37 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-e3467f86-4074-4467-bc66-58b038efde7a tempest-VolumesGetTest-3739209 None] Created reservations ['9218ce16-f626-4fa3-9b5f-6bf643cdf46e', 'e5751958-91c9-4109-b45b-4e927fe2b6a6', '6203b336-53c1-43bf-9deb-0cbebfb05715', '4192f973-9e89-4109-b488-c37d78b42cf4'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e3467f86-4074-4467-bc66-58b038efde7a tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e3467f86-4074-4467-bc66-58b038efde7a tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:37 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e3467f86-4074-4467-bc66-58b038efde7a tempest-VolumesGetTest-3739209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:37 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e3467f86-4074-4467-bc66-58b038efde7a tempest-VolumesGetTest-3739209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e3467f86-4074-4467-bc66-58b038efde7a tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e3467f86-4074-4467-bc66-58b038efde7a tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:37 devstack sudo[87356]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f90e634d-7253-4427-9bbe-edb5b0c31110 tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd" returned: 0 in 0.518s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:37 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-f90e634d-7253-4427-9bbe-edb5b0c31110 tempest-VolumesSnapshotListTestJSON-445713483 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd is being set with open permissions: ugo+rw Feb 27 02:07:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f90e634d-7253-4427-9bbe-edb5b0c31110 tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:37 devstack sudo[87362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:07:37 devstack sudo[87362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:37 devstack sudo[87368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd Feb 27 02:07:37 devstack sudo[87368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:37 devstack sudo[87362]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e3467f86-4074-4467-bc66-58b038efde7a tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.558s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:37 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-e3467f86-4074-4467-bc66-58b038efde7a tempest-VolumesGetTest-3739209 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:38 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e3467f86-4074-4467-bc66-58b038efde7a tempest-VolumesGetTest-3739209 None] Deleted volume successfully. Feb 27 02:07:38 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e3467f86-4074-4467-bc66-58b038efde7a tempest-VolumesGetTest-3739209 None] Lock "cinder-33eb6e43-be1f-47a1-b967-3b7c19ba87a4-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:38 devstack sudo[87368]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f90e634d-7253-4427-9bbe-edb5b0c31110 tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd" returned: 0 in 0.670s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f90e634d-7253-4427-9bbe-edb5b0c31110 tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.795s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:38 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-f90e634d-7253-4427-9bbe-edb5b0c31110 tempest-VolumesSnapshotListTestJSON-445713483 None] Create snapshot completed successfully Feb 27 02:07:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cf0f63ab-c25b-4fa8-b301-0ea7d2587d7e tempest-VolumesSnapshotListTestJSON-445713483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cf0f63ab-c25b-4fa8-b301-0ea7d2587d7e tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:38 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-cf0f63ab-c25b-4fa8-b301-0ea7d2587d7e tempest-VolumesSnapshotListTestJSON-445713483 None] Creating offline snapshot cbd2400a-cdd4-415a-ab7b-34c37ac12ace of volume 88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:38 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ac0f62-177b-45c7-84b7-4baec6fcf266]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cf0f63ab-c25b-4fa8-b301-0ea7d2587d7e tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:38 devstack sudo[87391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd Feb 27 02:07:38 devstack sudo[87391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:38 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:38 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Flow 'volume_create_manager' (de24592b-afbd-49d1-8aad-9577634ce2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:38 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff511370-7bbc-4242-a169-0000b7ad0ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:38 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff511370-7bbc-4242-a169-0000b7ad0ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2024319553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b731e4f75694a3aaa11f4c22c16c590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:39Z,use_quota=True,user_id='8384d6ce44e64c4b94fa949ce65b3a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:38 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4519f6da-43c6-4282-b9a2-4a3a79d0d51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:38 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4519f6da-43c6-4282-b9a2-4a3a79d0d51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:38 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443afbdf-25c4-4ffb-98b2-ad14ae40611f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:38 devstack cinder-volume[82738]: DEBUG cinder.image.glance [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Creating Keystone auth plugin from conf {{(pid=82738) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 02:07:39 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443afbdf-25c4-4ffb-98b2-ad14ae40611f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e', 'volume_name': 'volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e', 'volume_size': 1, 'image_id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db1770ccb718417cb73a54677fa92116', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'created_at': datetime.datetime(2026, 2, 27, 0, 57, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b706c9e-6966-424a-b9ee-45ddbab3a331/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:39 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b8e6247-9455-4570-a447-24409ddf9236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:39 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b8e6247-9455-4570-a447-24409ddf9236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:39 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76171b81-5c94-41d7-ae65-c7cd17fe6a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:39 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Volume 6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e', 'volume_size': 1, 'image_id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db1770ccb718417cb73a54677fa92116', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'created_at': datetime.datetime(2026, 2, 27, 0, 57, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b706c9e-6966-424a-b9ee-45ddbab3a331/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 02:07:39 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Trying to clone 6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e from image 4b706c9e-6966-424a-b9ee-45ddbab3a331 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}]). {{(pid=82738) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 02:07:39 devstack sudo[87391]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cf0f63ab-c25b-4fa8-b301-0ea7d2587d7e tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd" returned: 0 in 0.848s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:39 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-cf0f63ab-c25b-4fa8-b301-0ea7d2587d7e tempest-VolumesSnapshotListTestJSON-445713483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cf0f63ab-c25b-4fa8-b301-0ea7d2587d7e tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.cbd2400a-cdd4-415a-ab7b-34c37ac12ace 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:39 devstack sudo[87403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.cbd2400a-cdd4-415a-ab7b-34c37ac12ace 1G Feb 27 02:07:39 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:39 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_gkwq873pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82738) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 02:07:39 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Image download 20.69 MB at 20.69 MB/s Feb 27 02:07:39 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[074166db-f326-4074-ad16-1b3f4c041c07]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_gkwq873pdevstack@QuobyteHD {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:39 devstack sudo[87406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_gkwq873pdevstack@QuobyteHD Feb 27 02:07:39 devstack sudo[87406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:40 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cf0f63ab-c25b-4fa8-b301-0ea7d2587d7e tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.cbd2400a-cdd4-415a-ab7b-34c37ac12ace 1G" returned: 0 in 0.733s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cf0f63ab-c25b-4fa8-b301-0ea7d2587d7e tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.cbd2400a-cdd4-415a-ab7b-34c37ac12ace {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:40 devstack sudo[87414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.cbd2400a-cdd4-415a-ab7b-34c37ac12ace Feb 27 02:07:40 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:40 devstack sudo[87406]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_gkwq873pdevstack@QuobyteHD" returned: 0 in 0.705s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:40 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Temporary image 4b706c9e-6966-424a-b9ee-45ddbab3a331 is fetched for user 8384d6ce44e64c4b94fa949ce65b3a4e. {{(pid=82738) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 02:07:40 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbf26ca-ad2f-4cc0-b7c6-35f764257547]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_gkwq873pdevstack@QuobyteHD {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:40 devstack sudo[87416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_gkwq873pdevstack@QuobyteHD Feb 27 02:07:40 devstack sudo[87416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:40 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cf0f63ab-c25b-4fa8-b301-0ea7d2587d7e tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.cbd2400a-cdd4-415a-ab7b-34c37ac12ace" returned: 0 in 0.538s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:40 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-cf0f63ab-c25b-4fa8-b301-0ea7d2587d7e tempest-VolumesSnapshotListTestJSON-445713483 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.cbd2400a-cdd4-415a-ab7b-34c37ac12ace is being set with open permissions: ugo+rw Feb 27 02:07:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cf0f63ab-c25b-4fa8-b301-0ea7d2587d7e tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.cbd2400a-cdd4-415a-ab7b-34c37ac12ace {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:40 devstack sudo[87422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.cbd2400a-cdd4-415a-ab7b-34c37ac12ace Feb 27 02:07:40 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:41 devstack sudo[87416]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_gkwq873pdevstack@QuobyteHD" returned: 0 in 0.832s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:41 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cf0f63ab-c25b-4fa8-b301-0ea7d2587d7e tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.cbd2400a-cdd4-415a-ab7b-34c37ac12ace" returned: 0 in 0.727s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cf0f63ab-c25b-4fa8-b301-0ea7d2587d7e tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.917s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.305s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:41 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2024319553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b731e4f75694a3aaa11f4c22c16c590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:39Z,use_quota=True,user_id='8384d6ce44e64c4b94fa949ce65b3a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:41 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Creating volume 6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:41 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:41 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:41 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:41 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:07:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:41 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e 1073741824 Feb 27 02:07:41 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:41 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-cf0f63ab-c25b-4fa8-b301-0ea7d2587d7e tempest-VolumesSnapshotListTestJSON-445713483 None] Create snapshot completed successfully Feb 27 02:07:42 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e 1073741824" returned: 0 in 0.929s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:42 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e Feb 27 02:07:42 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:42 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] Acquiring lock "cinder-cbd2400a-cdd4-415a-ab7b-34c37ac12ace-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:42 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-cbd2400a-cdd4-415a-ab7b-34c37ac12ace-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:42 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] Acquiring lock "cinder-quobyte-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:42 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-quobyte-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:42 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] Acquiring lock "cinder-quobyte-cbd2400a-cdd4-415a-ab7b-34c37ac12ace" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:42 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-quobyte-cbd2400a-cdd4-415a-ab7b-34c37ac12ace" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:42 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] Deleting offline snapshot cbd2400a-cdd4-415a-ab7b-34c37ac12ace of volume 88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:42 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] snapshot_file for this snap is: volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.cbd2400a-cdd4-415a-ab7b-34c37ac12ace {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:42 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce045ae9-44b2-4a0e-a4bf-0ffd2b89af91]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.cbd2400a-cdd4-415a-ab7b-34c37ac12ace {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:42 devstack sudo[87460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.cbd2400a-cdd4-415a-ab7b-34c37ac12ace Feb 27 02:07:42 devstack sudo[87460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:43 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e" returned: 0 in 0.562s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:43 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:43 devstack cinder-volume[82738]: DEBUG cinder.volume.volume_utils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Attempting download of 4b706c9e-6966-424a-b9ee-45ddbab3a331 ((None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}])) to volume 6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e. {{(pid=82738) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 02:07:43 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3600207-4373-4d54-8420-747737e60568]: (4, 'raw') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_b25w0zw6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:43 devstack sudo[87463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_b25w0zw6 Feb 27 02:07:43 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:43 devstack sudo[87460]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.cbd2400a-cdd4-415a-ab7b-34c37ac12ace" returned: 0 in 0.729s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:43 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:43 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd8b360-09f8-4324-9fac-dbd04bf1c9df]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:43 devstack sudo[87468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd Feb 27 02:07:43 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:43 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_b25w0zw6" returned: 0 in 0.616s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_b25w0zw6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:43 devstack sudo[87472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_b25w0zw6 Feb 27 02:07:43 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:44 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd" returned: 0 in 0.906s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:44 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.cbd2400a-cdd4-415a-ab7b-34c37ac12ace {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:44 devstack sudo[87484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.cbd2400a-cdd4-415a-ab7b-34c37ac12ace Feb 27 02:07:44 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:44 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_b25w0zw6" returned: 1 in 0.705s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b706c9e-6966-424a-b9ee-45ddbab3a331_b25w0zw6' failed. Not Retrying. {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:07:44 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bc48cd-da75-4d35-8ae8-c97d151181ee]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_gkwq873pdevstack@QuobyteHD {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:44 devstack sudo[87499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_gkwq873pdevstack@QuobyteHD Feb 27 02:07:44 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:45 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_gkwq873pdevstack@QuobyteHD" returned: 0 in 0.693s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:45 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] 4b706c9e-6966-424a-b9ee-45ddbab3a331 was qcow2, converting to raw {{(pid=82738) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 02:07:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_gkwq873pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:45 devstack sudo[87512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_gkwq873pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e Feb 27 02:07:45 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:45 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.cbd2400a-cdd4-415a-ab7b-34c37ac12ace" returned: 0 in 1.005s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.cbd2400a-cdd4-415a-ab7b-34c37ac12ace {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:45 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.cbd2400a-cdd4-415a-ab7b-34c37ac12ace Feb 27 02:07:45 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:46 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.cbd2400a-cdd4-415a-ab7b-34c37ac12ace" returned: 0 in 1.000s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-quobyte-cbd2400a-cdd4-415a-ab7b-34c37ac12ace" released by "_delete_snapshot" :: held 3.738s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-quobyte-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3" released by "delete_snapshot" :: held 3.770s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:46 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] Created reservations ['2a2fc8f0-8dd6-4148-90a5-7f61e5be72ef', 'fc54cee9-623d-4959-aa95-4021dd0088fa', 'b92aaa33-852b-41f2-be63-8ba76f055689', 'c03ea1bf-cfae-4cf6-b8f7-466dedae84b1'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:46 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] Delete snapshot completed successfully. Feb 27 02:07:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8f2b7097-a01d-4663-9d1d-d9fdc67a4272 tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-cbd2400a-cdd4-415a-ab7b-34c37ac12ace-delete_snapshot" released by "delete_snapshot" :: held 3.950s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:46 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_gkwq873pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e" returned: 0 in 1.394s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:46 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4b706c9e-6966-424a-b9ee-45ddbab3a331_gkwq873pdevstack@QuobyteHD, size 112.00 MB, duration 1.39 sec, destination /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e {{(pid=82738) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:07:46 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Converted 112.00 MB image at 80.30 MB/s Feb 27 02:07:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:46 devstack sudo[87543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e 1G Feb 27 02:07:46 devstack sudo[87543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] Acquiring lock "cinder-a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] Acquiring lock "cinder-quobyte-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-quobyte-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] Acquiring lock "cinder-quobyte-a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-quobyte-a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] Deleting offline snapshot a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd of volume 88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] snapshot_file for this snap is: volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:46 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[d648c232-f29f-469d-8d96-f366d1ac8362]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:47 devstack sudo[87545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd Feb 27 02:07:47 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:47 devstack sudo[87543]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e 1G" returned: 0 in 0.643s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:47 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f350bae-9795-4348-9be2-af54b080ab66]: (4, 'raw') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:47 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e Feb 27 02:07:47 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:47 devstack cinder-volume[82738]: INFO cinder.volume.manager [req-121399a8-389e-49da-889e-90f001af31f3 req-b6e35bdb-3d79-4c7f-9ab7-361745685c9c tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Terminate volume connection completed successfully. Feb 27 02:07:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-121399a8-389e-49da-889e-90f001af31f3 req-b6e35bdb-3d79-4c7f-9ab7-361745685c9c tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Deleting attachment 5915d823-ffce-4d73-b3da-811e21c40a35. {{(pid=82738) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 02:07:47 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd" returned: 0 in 0.901s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:47 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3900efa-c71e-499c-8cfb-ae9cf33fb02f]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:47 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 Feb 27 02:07:47 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:48 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:48 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-121399a8-389e-49da-889e-90f001af31f3 req-7e821d28-43e9-412c-a887-af0190376d6f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Acquiring lock "cinder-d264f466-da73-495e-85f9-6734a8445c79-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e" returned: 0 in 0.786s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:48 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-121399a8-389e-49da-889e-90f001af31f3 req-7e821d28-43e9-412c-a887-af0190376d6f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "cinder-d264f466-da73-495e-85f9-6734a8445c79-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:48 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-121399a8-389e-49da-889e-90f001af31f3 req-7e821d28-43e9-412c-a887-af0190376d6f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Acquiring lock "cinder-quobyte-d264f466-da73-495e-85f9-6734a8445c79" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:48 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-121399a8-389e-49da-889e-90f001af31f3 req-7e821d28-43e9-412c-a887-af0190376d6f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "cinder-quobyte-d264f466-da73-495e-85f9-6734a8445c79" acquired by "delete_volume" :: waited 0.017s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:48 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e Feb 27 02:07:48 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:48 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec8256c-b674-4cca-95d8-ab79a03ca91d]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-121399a8-389e-49da-889e-90f001af31f3 req-7e821d28-43e9-412c-a887-af0190376d6f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d264f466-da73-495e-85f9-6734a8445c79 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:48 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d264f466-da73-495e-85f9-6734a8445c79 Feb 27 02:07:48 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:48 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8" returned: 0 in 0.709s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:48 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:48 devstack sudo[87567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd Feb 27 02:07:48 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:48 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e" returned: 1 in 0.771s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e' failed. Not Retrying. {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:07:48 devstack cinder-volume[82738]: DEBUG cinder.volume.volume_utils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Downloaded image 4b706c9e-6966-424a-b9ee-45ddbab3a331 ((None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}])) to volume 6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e successfully. {{(pid=82738) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 02:07:48 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Temporary image 4b706c9e-6966-424a-b9ee-45ddbab3a331 for user 8384d6ce44e64c4b94fa949ce65b3a4e is deleted. {{(pid=82738) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 02:07:48 devstack cinder-volume[82738]: DEBUG cinder.volume.volume_utils [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Marking volume 6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e as bootable. {{(pid=82738) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 02:07:48 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Copying metadata from image 4b706c9e-6966-424a-b9ee-45ddbab3a331 to 6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e. {{(pid=82738) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 02:07:48 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Creating volume glance metadata for volume 6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e backed by image 4b706c9e-6966-424a-b9ee-45ddbab3a331 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82738) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 02:07:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76171b81-5c94-41d7-ae65-c7cd17fe6a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e', 'volume_size': 1, 'image_id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b706c9e-6966-424a-b9ee-45ddbab3a331', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db1770ccb718417cb73a54677fa92116', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b706c9e-6966-424a-b9ee-45ddbab3a331', 'created_at': datetime.datetime(2026, 2, 27, 0, 57, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b706c9e-6966-424a-b9ee-45ddbab3a331/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:49 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05d6188-9cf0-4507-870d-15aa0220fe01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:49 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Volume volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e (6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e): created successfully Feb 27 02:07:49 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05d6188-9cf0-4507-870d-15aa0220fe01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:49 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Flow 'volume_create_manager' (de24592b-afbd-49d1-8aad-9577634ce2ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:49 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-773b23cb-630c-4cb7-ba6a-a6eb99c1e387 tempest-VolumesGetTest-3739209 None] Created volume successfully. Feb 27 02:07:49 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-121399a8-389e-49da-889e-90f001af31f3 req-7e821d28-43e9-412c-a887-af0190376d6f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d264f466-da73-495e-85f9-6734a8445c79" returned: 0 in 0.864s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-121399a8-389e-49da-889e-90f001af31f3 req-7e821d28-43e9-412c-a887-af0190376d6f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d264f466-da73-495e-85f9-6734a8445c79 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:49 devstack sudo[87575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d264f466-da73-495e-85f9-6734a8445c79 Feb 27 02:07:49 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:49 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd" returned: 0 in 0.719s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:49 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd Feb 27 02:07:49 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:49 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-121399a8-389e-49da-889e-90f001af31f3 req-7e821d28-43e9-412c-a887-af0190376d6f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d264f466-da73-495e-85f9-6734a8445c79" returned: 0 in 0.510s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-121399a8-389e-49da-889e-90f001af31f3 req-7e821d28-43e9-412c-a887-af0190376d6f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "cinder-quobyte-d264f466-da73-495e-85f9-6734a8445c79" released by "delete_volume" :: held 1.414s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:49 devstack cinder-volume[82738]: DEBUG cinder.quota [req-121399a8-389e-49da-889e-90f001af31f3 req-7e821d28-43e9-412c-a887-af0190376d6f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Created reservations ['82eec00b-e9fe-4c62-96ce-b5c7d3528609', '9049171a-73e4-4bc9-9d2e-89ded6fcd001', 'c0a616f9-9c4f-4129-bc9c-c34526bcfa7e', 'b246063e-a0aa-46c1-9a24-deeac93a000a'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-121399a8-389e-49da-889e-90f001af31f3 req-7e821d28-43e9-412c-a887-af0190376d6f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-121399a8-389e-49da-889e-90f001af31f3 req-7e821d28-43e9-412c-a887-af0190376d6f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:49 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-121399a8-389e-49da-889e-90f001af31f3 req-7e821d28-43e9-412c-a887-af0190376d6f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:49 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-121399a8-389e-49da-889e-90f001af31f3 req-7e821d28-43e9-412c-a887-af0190376d6f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-121399a8-389e-49da-889e-90f001af31f3 req-7e821d28-43e9-412c-a887-af0190376d6f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-121399a8-389e-49da-889e-90f001af31f3 req-7e821d28-43e9-412c-a887-af0190376d6f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:49 devstack sudo[87583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:07:49 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:49 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd" returned: 0 in 0.580s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-quobyte-a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd" released by "_delete_snapshot" :: held 2.987s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-quobyte-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3" released by "delete_snapshot" :: held 3.023s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:49 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] Created reservations ['ffc67aa7-b13d-499f-bf49-7c916cdf9f87', '5ccd74ee-0d6e-4c50-a40b-769f0d541f83', '7d5edfe8-9253-4a61-aea5-092c3ffb28b6', 'd72307a5-4007-434a-a565-39d741b4d9f1'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:50 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] Delete snapshot completed successfully. Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0735b203-183f-4802-9b2f-9b4d394415af tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-a12ab8eb-a3e7-48a8-8846-8b5354d2c1cd-delete_snapshot" released by "delete_snapshot" :: held 3.184s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:50 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-121399a8-389e-49da-889e-90f001af31f3 req-7e821d28-43e9-412c-a887-af0190376d6f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.555s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG cinder.manager [req-121399a8-389e-49da-889e-90f001af31f3 req-7e821d28-43e9-412c-a887-af0190376d6f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:50 devstack cinder-volume[82738]: INFO cinder.volume.manager [req-121399a8-389e-49da-889e-90f001af31f3 req-7e821d28-43e9-412c-a887-af0190376d6f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Deleted volume successfully. Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Flow 'volume_create_manager' (c2b5df99-e8d8-45bc-8ada-de16c13fc4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52333a10-ccf9-49c9-ab25-1fdaec7defe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52333a10-ccf9-49c9-ab25-1fdaec7defe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-759525724',display_name='tempest-VolumesGetTest-Volume-1471355726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29ed77b-3c2a-4774-9505-902778db5df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b731e4f75694a3aaa11f4c22c16c590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:50Z,use_quota=True,user_id='8384d6ce44e64c4b94fa949ce65b3a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be4651d-c5f5-4dab-8a10-02029bd6f868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be4651d-c5f5-4dab-8a10-02029bd6f868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2195de-36eb-4803-b119-d9bb7603aeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2195de-36eb-4803-b119-d9bb7603aeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b29ed77b-3c2a-4774-9505-902778db5df8', 'volume_name': 'volume-b29ed77b-3c2a-4774-9505-902778db5df8', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99bacf4-a88a-45dc-929b-31b61ccf7bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99bacf4-a88a-45dc-929b-31b61ccf7bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5dd1fa7-9700-4809-8e7e-9f2fe91b5a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Volume b29ed77b-3c2a-4774-9505-902778db5df8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b29ed77b-3c2a-4774-9505-902778db5df8', 'volume_size': 1} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-759525724',display_name='tempest-VolumesGetTest-Volume-1471355726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29ed77b-3c2a-4774-9505-902778db5df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b731e4f75694a3aaa11f4c22c16c590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:50Z,use_quota=True,user_id='8384d6ce44e64c4b94fa949ce65b3a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Creating volume b29ed77b-3c2a-4774-9505-902778db5df8 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:50 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b29ed77b-3c2a-4774-9505-902778db5df8 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-121399a8-389e-49da-889e-90f001af31f3 req-7e821d28-43e9-412c-a887-af0190376d6f tempest-ServerBootFromVolumeStableRescueTest-2028899909 None] Lock "cinder-d264f466-da73-495e-85f9-6734a8445c79-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:50 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b29ed77b-3c2a-4774-9505-902778db5df8 1073741824 Feb 27 02:07:50 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:50 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b29ed77b-3c2a-4774-9505-902778db5df8 1073741824" returned: 0 in 0.565s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b29ed77b-3c2a-4774-9505-902778db5df8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:50 devstack sudo[87593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b29ed77b-3c2a-4774-9505-902778db5df8 Feb 27 02:07:50 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] Acquiring lock "cinder-3cf28002-a429-47c4-8cdb-d74ed16127c8-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-3cf28002-a429-47c4-8cdb-d74ed16127c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] Acquiring lock "cinder-quobyte-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-quobyte-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] Acquiring lock "cinder-quobyte-3cf28002-a429-47c4-8cdb-d74ed16127c8" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-quobyte-3cf28002-a429-47c4-8cdb-d74ed16127c8" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] Deleting offline snapshot 3cf28002-a429-47c4-8cdb-d74ed16127c8 of volume 88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] snapshot_file for this snap is: volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05e5a6b-cdde-4940-9f54-34865cae6cad]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:51 devstack sudo[87595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 Feb 27 02:07:51 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:51 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b29ed77b-3c2a-4774-9505-902778db5df8" returned: 0 in 0.498s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5dd1fa7-9700-4809-8e7e-9f2fe91b5a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29ed77b-3c2a-4774-9505-902778db5df8', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153df852-68a6-4a29-8025-f97950b49440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Volume volume-b29ed77b-3c2a-4774-9505-902778db5df8 (b29ed77b-3c2a-4774-9505-902778db5df8): created successfully Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153df852-68a6-4a29-8025-f97950b49440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Flow 'volume_create_manager' (c2b5df99-e8d8-45bc-8ada-de16c13fc4c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:51 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-7dd1e1e6-bbdd-472b-a8e9-537724211c84 tempest-VolumesGetTest-3739209 None] Created volume successfully. Feb 27 02:07:51 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8" returned: 0 in 0.614s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a24a758-80e9-4438-ae84-a386d01196c3]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:51 devstack sudo[87601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 Feb 27 02:07:51 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:52 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3" returned: 0 in 0.581s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:52 devstack sudo[87606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 Feb 27 02:07:52 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:52 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f374a9f7-0f0a-40b4-bc0a-c98d21bd75b9 tempest-VolumesGetTest-3739209 None] Acquiring lock "cinder-b29ed77b-3c2a-4774-9505-902778db5df8-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:52 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f374a9f7-0f0a-40b4-bc0a-c98d21bd75b9 tempest-VolumesGetTest-3739209 None] Lock "cinder-b29ed77b-3c2a-4774-9505-902778db5df8-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:52 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f374a9f7-0f0a-40b4-bc0a-c98d21bd75b9 tempest-VolumesGetTest-3739209 None] Acquiring lock "cinder-quobyte-b29ed77b-3c2a-4774-9505-902778db5df8" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:52 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f374a9f7-0f0a-40b4-bc0a-c98d21bd75b9 tempest-VolumesGetTest-3739209 None] Lock "cinder-quobyte-b29ed77b-3c2a-4774-9505-902778db5df8" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:52 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcc79dd-f44d-4f7c-b800-46b03ae82a4a]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f374a9f7-0f0a-40b4-bc0a-c98d21bd75b9 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b29ed77b-3c2a-4774-9505-902778db5df8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:52 devstack sudo[87617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b29ed77b-3c2a-4774-9505-902778db5df8 Feb 27 02:07:52 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:53 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8" returned: 0 in 0.713s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:53 devstack sudo[87641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8 Feb 27 02:07:53 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:53 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f374a9f7-0f0a-40b4-bc0a-c98d21bd75b9 tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b29ed77b-3c2a-4774-9505-902778db5df8" returned: 0 in 0.842s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f374a9f7-0f0a-40b4-bc0a-c98d21bd75b9 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b29ed77b-3c2a-4774-9505-902778db5df8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:53 devstack sudo[87647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b29ed77b-3c2a-4774-9505-902778db5df8 Feb 27 02:07:53 devstack sudo[87647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:53 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3.3cf28002-a429-47c4-8cdb-d74ed16127c8" returned: 0 in 0.590s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:53 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=161,cinder:INSERT=74,cinder:UPDATE=177,cinder:DELETE=10 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:07:53 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-quobyte-3cf28002-a429-47c4-8cdb-d74ed16127c8" released by "_delete_snapshot" :: held 2.587s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:53 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-quobyte-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3" released by "delete_snapshot" :: held 2.611s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:53 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] Created reservations ['fa310421-83b2-402b-a02a-775c70803f33', '8461131c-40a8-44a8-8ecd-6adbff364243', '7d887937-c58e-48ba-8702-7060ea1b94de', '5abb04f8-dacd-4e5c-a358-075efae63daa'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:53 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] Delete snapshot completed successfully. Feb 27 02:07:53 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fd133b99-f768-43ac-bc16-6bd990a8be2f tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-3cf28002-a429-47c4-8cdb-d74ed16127c8-delete_snapshot" released by "delete_snapshot" :: held 2.780s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:54 devstack sudo[87647]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f374a9f7-0f0a-40b4-bc0a-c98d21bd75b9 tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b29ed77b-3c2a-4774-9505-902778db5df8" returned: 0 in 0.545s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f374a9f7-0f0a-40b4-bc0a-c98d21bd75b9 tempest-VolumesGetTest-3739209 None] Lock "cinder-quobyte-b29ed77b-3c2a-4774-9505-902778db5df8" released by "delete_volume" :: held 1.417s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-f374a9f7-0f0a-40b4-bc0a-c98d21bd75b9 tempest-VolumesGetTest-3739209 None] Created reservations ['714a4cb1-25f9-44d0-9bad-7c918db54eb2', '731f0514-8648-42ae-a873-1551af11020e', '5aca8649-cb75-4bd2-99ba-2d301f3ffba5', '8b676b0b-64cb-4682-8059-9f2bb4d95b62'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f374a9f7-0f0a-40b4-bc0a-c98d21bd75b9 tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f374a9f7-0f0a-40b4-bc0a-c98d21bd75b9 tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f374a9f7-0f0a-40b4-bc0a-c98d21bd75b9 tempest-VolumesGetTest-3739209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f374a9f7-0f0a-40b4-bc0a-c98d21bd75b9 tempest-VolumesGetTest-3739209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f374a9f7-0f0a-40b4-bc0a-c98d21bd75b9 tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f374a9f7-0f0a-40b4-bc0a-c98d21bd75b9 tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:54 devstack sudo[87653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:07:54 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ab7b76d0-1370-498d-aba8-034c0ab39675 tempest-VolumesSnapshotListTestJSON-445713483 None] Acquiring lock "cinder-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ab7b76d0-1370-498d-aba8-034c0ab39675 tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ab7b76d0-1370-498d-aba8-034c0ab39675 tempest-VolumesSnapshotListTestJSON-445713483 None] Acquiring lock "cinder-quobyte-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ab7b76d0-1370-498d-aba8-034c0ab39675 tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-quobyte-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7b1719-1547-4343-86ef-3ab11d1b7378]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ab7b76d0-1370-498d-aba8-034c0ab39675 tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:54 devstack sudo[87656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 Feb 27 02:07:54 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:54 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f374a9f7-0f0a-40b4-bc0a-c98d21bd75b9 tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.622s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-f374a9f7-0f0a-40b4-bc0a-c98d21bd75b9 tempest-VolumesGetTest-3739209 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:54 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-f374a9f7-0f0a-40b4-bc0a-c98d21bd75b9 tempest-VolumesGetTest-3739209 None] Deleted volume successfully. Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f374a9f7-0f0a-40b4-bc0a-c98d21bd75b9 tempest-VolumesGetTest-3739209 None] Lock "cinder-b29ed77b-3c2a-4774-9505-902778db5df8-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] Acquiring lock "cinder-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] Lock "cinder-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] Acquiring lock "cinder-quobyte-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:54 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] Lock "cinder-quobyte-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e" acquired by "delete_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:55 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e0dba2-f527-4b01-b9e1-30b457389170]: (4, 'raw') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:55 devstack sudo[87659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e Feb 27 02:07:55 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:55 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ab7b76d0-1370-498d-aba8-034c0ab39675 tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3" returned: 0 in 0.697s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ab7b76d0-1370-498d-aba8-034c0ab39675 tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:55 devstack sudo[87664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3 Feb 27 02:07:55 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:55 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e" returned: 0 in 0.712s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:55 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ab7b76d0-1370-498d-aba8-034c0ab39675 tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3" returned: 0 in 0.539s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:55 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ab7b76d0-1370-498d-aba8-034c0ab39675 tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-quobyte-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3" released by "delete_volume" :: held 1.273s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:55 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-ab7b76d0-1370-498d-aba8-034c0ab39675 tempest-VolumesSnapshotListTestJSON-445713483 None] Created reservations ['22d29345-0abd-4da2-808c-c25e4cbbd7d2', '3a71f5a1-e11a-4655-8ded-c00c02d5a916', '24b452f8-8c9f-4d31-8251-3469275de897', '4fb0663e-75ad-40d4-bc03-b436abfb9374'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:55 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e Feb 27 02:07:55 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ab7b76d0-1370-498d-aba8-034c0ab39675 tempest-VolumesSnapshotListTestJSON-445713483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ab7b76d0-1370-498d-aba8-034c0ab39675 tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:55 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ab7b76d0-1370-498d-aba8-034c0ab39675 tempest-VolumesSnapshotListTestJSON-445713483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:55 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ab7b76d0-1370-498d-aba8-034c0ab39675 tempest-VolumesSnapshotListTestJSON-445713483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ab7b76d0-1370-498d-aba8-034c0ab39675 tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ab7b76d0-1370-498d-aba8-034c0ab39675 tempest-VolumesSnapshotListTestJSON-445713483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:55 devstack sudo[87671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:07:55 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:56 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e" returned: 1 in 0.637s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e' failed. Not Retrying. {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:07:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:56 devstack sudo[87677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e Feb 27 02:07:56 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:56 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ab7b76d0-1370-498d-aba8-034c0ab39675 tempest-VolumesSnapshotListTestJSON-445713483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.564s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:56 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-ab7b76d0-1370-498d-aba8-034c0ab39675 tempest-VolumesSnapshotListTestJSON-445713483 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:56 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-ab7b76d0-1370-498d-aba8-034c0ab39675 tempest-VolumesSnapshotListTestJSON-445713483 None] Deleted volume successfully. Feb 27 02:07:56 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ab7b76d0-1370-498d-aba8-034c0ab39675 tempest-VolumesSnapshotListTestJSON-445713483 None] Lock "cinder-88c3daf2-07a1-46bd-8eed-f39cbcabc2c3-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:56 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e" returned: 0 in 0.503s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:56 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] Lock "cinder-quobyte-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e" released by "delete_volume" :: held 1.900s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:56 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] Created reservations ['61d0c609-2414-4bb0-86bc-18333d034427', 'a84087f2-51b9-430c-8518-24bab14784cc', 'f8e6a3f8-6015-42e5-83ac-3ac3d4bb93ce', 'c0a5ba63-2169-47b8-b76d-3aa9b4defae3'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:57 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:57 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:07:57 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:57 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d865f3a7-f369-4af4-9d62-a51a297abff6 tempest-VolumesNegativeTest-590141471 None] Acquiring lock "cinder-107a59fa-234f-4fbe-a7f5-b9c7e2789920-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:57 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d865f3a7-f369-4af4-9d62-a51a297abff6 tempest-VolumesNegativeTest-590141471 None] Lock "cinder-107a59fa-234f-4fbe-a7f5-b9c7e2789920-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:57 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d865f3a7-f369-4af4-9d62-a51a297abff6 tempest-VolumesNegativeTest-590141471 None] Acquiring lock "cinder-quobyte-107a59fa-234f-4fbe-a7f5-b9c7e2789920" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:57 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d865f3a7-f369-4af4-9d62-a51a297abff6 tempest-VolumesNegativeTest-590141471 None] Lock "cinder-quobyte-107a59fa-234f-4fbe-a7f5-b9c7e2789920" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:57 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[295207db-9e0b-4839-af48-8a121778c124]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d865f3a7-f369-4af4-9d62-a51a297abff6 tempest-VolumesNegativeTest-590141471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-107a59fa-234f-4fbe-a7f5-b9c7e2789920 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:57 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-107a59fa-234f-4fbe-a7f5-b9c7e2789920 Feb 27 02:07:57 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:57 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.718s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:57 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:57 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] Deleted volume successfully. Feb 27 02:07:57 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e29b4ad2-e9f0-4fd2-8452-33638ba0b29e tempest-VolumesGetTest-3739209 None] Lock "cinder-6f268cee-fcd1-4a2a-a6e4-c941ac1eca8e-delete_volume" released by "delete_volume" :: held 2.861s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:58 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d865f3a7-f369-4af4-9d62-a51a297abff6 tempest-VolumesNegativeTest-590141471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-107a59fa-234f-4fbe-a7f5-b9c7e2789920" returned: 0 in 0.880s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d865f3a7-f369-4af4-9d62-a51a297abff6 tempest-VolumesNegativeTest-590141471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-107a59fa-234f-4fbe-a7f5-b9c7e2789920 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:58 devstack sudo[87688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-107a59fa-234f-4fbe-a7f5-b9c7e2789920 Feb 27 02:07:58 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:58 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d865f3a7-f369-4af4-9d62-a51a297abff6 tempest-VolumesNegativeTest-590141471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-107a59fa-234f-4fbe-a7f5-b9c7e2789920" returned: 0 in 0.685s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:58 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d865f3a7-f369-4af4-9d62-a51a297abff6 tempest-VolumesNegativeTest-590141471 None] Lock "cinder-quobyte-107a59fa-234f-4fbe-a7f5-b9c7e2789920" released by "delete_volume" :: held 1.594s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-d865f3a7-f369-4af4-9d62-a51a297abff6 tempest-VolumesNegativeTest-590141471 None] Created reservations ['5ec39391-9f52-4c17-8f0b-061f76702bac', '36226ad2-2481-4574-b708-61bf4562f10d', 'affa8c83-04fa-4ada-824f-9fe7d2873064', '84725bad-1848-4132-897f-a3e75c3fc24e'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d865f3a7-f369-4af4-9d62-a51a297abff6 tempest-VolumesNegativeTest-590141471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d865f3a7-f369-4af4-9d62-a51a297abff6 tempest-VolumesNegativeTest-590141471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d865f3a7-f369-4af4-9d62-a51a297abff6 tempest-VolumesNegativeTest-590141471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d865f3a7-f369-4af4-9d62-a51a297abff6 tempest-VolumesNegativeTest-590141471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d865f3a7-f369-4af4-9d62-a51a297abff6 tempest-VolumesNegativeTest-590141471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d865f3a7-f369-4af4-9d62-a51a297abff6 tempest-VolumesNegativeTest-590141471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:59 devstack sudo[87691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:07:59 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:59 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Flow 'volume_create_manager' (e0810df2-a24a-4532-aca9-dac8f42d0b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647c14da-7e8e-48d1-bed9-8f5ba4f6442d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647c14da-7e8e-48d1-bed9-8f5ba4f6442d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1320716122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2295e10-04f7-4b1b-abba-1aaf61a30090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d419c9c9b44d7ea4077b1c7902597b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:00Z,use_quota=True,user_id='09d4cfb5f340443d80691ba8ebe62160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8b2947-fefe-4507-bc49-8129e4f7bd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8b2947-fefe-4507-bc49-8129e4f7bd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c305da-7c83-4667-9f02-391bbefa0486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c305da-7c83-4667-9f02-391bbefa0486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2295e10-04f7-4b1b-abba-1aaf61a30090', 'volume_name': 'volume-b2295e10-04f7-4b1b-abba-1aaf61a30090', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (163cd057-32da-4ae0-b8c2-055c553a14fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (163cd057-32da-4ae0-b8c2-055c553a14fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd17ea17-e9d9-4747-968c-bcb4705afb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:59 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Volume b2295e10-04f7-4b1b-abba-1aaf61a30090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2295e10-04f7-4b1b-abba-1aaf61a30090', 'volume_size': 1} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1320716122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2295e10-04f7-4b1b-abba-1aaf61a30090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d419c9c9b44d7ea4077b1c7902597b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:00Z,use_quota=True,user_id='09d4cfb5f340443d80691ba8ebe62160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Creating volume b2295e10-04f7-4b1b-abba-1aaf61a30090 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:59 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b2295e10-04f7-4b1b-abba-1aaf61a30090 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d865f3a7-f369-4af4-9d62-a51a297abff6 tempest-VolumesNegativeTest-590141471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.864s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-d865f3a7-f369-4af4-9d62-a51a297abff6 tempest-VolumesNegativeTest-590141471 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:59 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-d865f3a7-f369-4af4-9d62-a51a297abff6 tempest-VolumesNegativeTest-590141471 None] Deleted volume successfully. Feb 27 02:07:59 devstack sudo[87695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b2295e10-04f7-4b1b-abba-1aaf61a30090 1073741824 Feb 27 02:07:59 devstack sudo[87695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:59 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d865f3a7-f369-4af4-9d62-a51a297abff6 tempest-VolumesNegativeTest-590141471 None] Lock "cinder-107a59fa-234f-4fbe-a7f5-b9c7e2789920-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:00 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Flow 'volume_create_manager' (4c7e5710-b6bb-46cd-9298-00f2dfff6eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a24d0a8-11a4-4f73-93ca-d2c551302323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a24d0a8-11a4-4f73-93ca-d2c551302323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1432817693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f734ece9924bb2afe86213d71cc84b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:00Z,use_quota=True,user_id='48e846b2b1ab4f9690ac0d5d71062be7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e966edbf-30df-46b2-a550-240814b67728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e966edbf-30df-46b2-a550-240814b67728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b37cfe-9e36-4685-91a4-9429bf4ad6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b37cfe-9e36-4685-91a4-9429bf4ad6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2', 'volume_name': 'volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2', 'volume_size': 2}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2010b6ee-66c4-41bc-a8e0-c12d4635fcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2010b6ee-66c4-41bc-a8e0-c12d4635fcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73de8329-4603-45f3-95e6-5c56b1cf153c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:00 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Volume 13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2', 'volume_size': 2} Feb 27 02:08:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:00 devstack sudo[87695]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b2295e10-04f7-4b1b-abba-1aaf61a30090 1073741824" returned: 0 in 0.703s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b2295e10-04f7-4b1b-abba-1aaf61a30090 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:00 devstack sudo[87701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b2295e10-04f7-4b1b-abba-1aaf61a30090 Feb 27 02:08:00 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:01 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b2295e10-04f7-4b1b-abba-1aaf61a30090" returned: 0 in 0.535s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.950s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1432817693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f734ece9924bb2afe86213d71cc84b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:00Z,use_quota=True,user_id='48e846b2b1ab4f9690ac0d5d71062be7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Creating volume 13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:01 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:08:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2 2147483648 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd17ea17-e9d9-4747-968c-bcb4705afb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2295e10-04f7-4b1b-abba-1aaf61a30090', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b854d8ae-00b7-4616-a194-6d6c2490dee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:01 devstack sudo[87704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2 2147483648 Feb 27 02:08:01 devstack sudo[87704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:01 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Volume volume-b2295e10-04f7-4b1b-abba-1aaf61a30090 (b2295e10-04f7-4b1b-abba-1aaf61a30090): created successfully Feb 27 02:08:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b854d8ae-00b7-4616-a194-6d6c2490dee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Flow 'volume_create_manager' (e0810df2-a24a-4532-aca9-dac8f42d0b91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:01 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-7f2c0746-e944-4b69-a994-7c39acbf7c55 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Created volume successfully. Feb 27 02:08:02 devstack sudo[87704]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2 2147483648" returned: 0 in 0.956s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:02 devstack sudo[87710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2 Feb 27 02:08:02 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Flow 'volume_create_manager' (961c8a25-7282-40b3-9659-73c2258f637b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6500f8cb-6d1a-4f65-b979-7924cc80266a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6500f8cb-6d1a-4f65-b979-7924cc80266a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1843509701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b71f060-78c8-4b03-b2fc-82ef0dd2cd66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d419c9c9b44d7ea4077b1c7902597b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:02Z,use_quota=True,user_id='09d4cfb5f340443d80691ba8ebe62160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282fd7ab-b486-4463-8550-8165b72f33ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282fd7ab-b486-4463-8550-8165b72f33ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd5ea2f-9966-4dc5-b867-f240b2beec91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd5ea2f-9966-4dc5-b867-f240b2beec91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b71f060-78c8-4b03-b2fc-82ef0dd2cd66', 'volume_name': 'volume-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4063229a-ca73-4362-86b8-ffda5db11b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4063229a-ca73-4362-86b8-ffda5db11b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab44c46-cbf6-4276-b63e-b3100f14eac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:02 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Volume 8b71f060-78c8-4b03-b2fc-82ef0dd2cd66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66', 'volume_size': 1} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Flow 'volume_create_manager' (c13c7207-b647-4dcb-bfa5-d2c5b4841679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de57ba3-8a07-4ab7-aba7-1712711d5e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de57ba3-8a07-4ab7-aba7-1712711d5e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-874925155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b61855f-af1d-4cc1-b801-d9926657f468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d419c9c9b44d7ea4077b1c7902597b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:03Z,use_quota=True,user_id='09d4cfb5f340443d80691ba8ebe62160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314f5a51-d372-4f6f-bf96-a7d88ccff8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314f5a51-d372-4f6f-bf96-a7d88ccff8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392cd876-fa5e-45c5-ba5e-a30444fa449e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392cd876-fa5e-45c5-ba5e-a30444fa449e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b61855f-af1d-4cc1-b801-d9926657f468', 'volume_name': 'volume-9b61855f-af1d-4cc1-b801-d9926657f468', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66c1bab-fe7b-4e4a-aada-8bc4ae2075d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66c1bab-fe7b-4e4a-aada-8bc4ae2075d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8766370-29ce-4720-813b-da295a4fff8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:02 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Volume 9b61855f-af1d-4cc1-b801-d9926657f468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b61855f-af1d-4cc1-b801-d9926657f468', 'volume_size': 1} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Flow 'volume_create_manager' (97f2445d-4b4a-4150-86e3-9e743d2f4bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a934b1-7383-4acf-a555-8c2ede69cefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:02 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=128,cinder:INSERT=39,cinder:UPDATE=175,cinder:DELETE=20 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a934b1-7383-4acf-a555-8c2ede69cefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1880995438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5bfa606-2a4e-4d52-b9e6-39d08c612b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d419c9c9b44d7ea4077b1c7902597b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:03Z,use_quota=True,user_id='09d4cfb5f340443d80691ba8ebe62160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231ec057-c75b-45cc-96ad-5143ee326101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231ec057-c75b-45cc-96ad-5143ee326101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b065d2f-13f5-4a55-8f98-4a5db9da74da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b065d2f-13f5-4a55-8f98-4a5db9da74da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5bfa606-2a4e-4d52-b9e6-39d08c612b54', 'volume_name': 'volume-d5bfa606-2a4e-4d52-b9e6-39d08c612b54', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba75ff9e-6436-4cb5-afa2-1ab8abfd14c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba75ff9e-6436-4cb5-afa2-1ab8abfd14c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711270ab-a2c0-477e-8d21-e1db11611878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Volume d5bfa606-2a4e-4d52-b9e6-39d08c612b54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5bfa606-2a4e-4d52-b9e6-39d08c612b54', 'volume_size': 1} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:03 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2" returned: 0 in 0.866s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.625s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1843509701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b71f060-78c8-4b03-b2fc-82ef0dd2cd66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d419c9c9b44d7ea4077b1c7902597b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:02Z,use_quota=True,user_id='09d4cfb5f340443d80691ba8ebe62160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Creating volume 8b71f060-78c8-4b03-b2fc-82ef0dd2cd66 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:03 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73de8329-4603-45f3-95e6-5c56b1cf153c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2', 'volume_size': 2}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d648daf5-0501-4363-8d26-f2b9b9d165cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66 1073741824 Feb 27 02:08:03 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:03 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Volume volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2 (13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2): created successfully Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d648daf5-0501-4363-8d26-f2b9b9d165cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Flow 'volume_create_manager' (4c7e5710-b6bb-46cd-9298-00f2dfff6eb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:03 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-7ec5cc84-9ee2-4f66-817e-97665cd01c5a tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Created volume successfully. Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Flow 'volume_create_manager' (f67e5c21-b0ed-458f-9ea2-b41e873dc591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02080513-a15f-40d2-8e80-a3737ead1ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02080513-a15f-40d2-8e80-a3737ead1ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-735972587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd8d1e95-34b3-4f07-9638-79e33fab6f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d419c9c9b44d7ea4077b1c7902597b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:03Z,use_quota=True,user_id='09d4cfb5f340443d80691ba8ebe62160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7060bf2-deeb-467d-ac2c-ae5f1e7d16e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7060bf2-deeb-467d-ac2c-ae5f1e7d16e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90bdbf86-b77d-4dec-835b-a411aced3386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90bdbf86-b77d-4dec-835b-a411aced3386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd8d1e95-34b3-4f07-9638-79e33fab6f79', 'volume_name': 'volume-bd8d1e95-34b3-4f07-9638-79e33fab6f79', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4a5f35-a282-4382-a2b7-30fba633e4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4a5f35-a282-4382-a2b7-30fba633e4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3509a96f-67fd-4721-8dfe-d4998a251945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Volume bd8d1e95-34b3-4f07-9638-79e33fab6f79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd8d1e95-34b3-4f07-9638-79e33fab6f79', 'volume_size': 1} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f92c7c9e-5be7-4766-ab20-c6bf9c83111c tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Flow 'volume_create_manager' (f1d38cb2-6831-4d6d-b753-d525b0f5bb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4e9e98-e80d-42ec-bbad-ae11508f0c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4e9e98-e80d-42ec-bbad-ae11508f0c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1181548889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a51fc31-938b-41b4-90a1-19f1a99986c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d419c9c9b44d7ea4077b1c7902597b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:04Z,use_quota=True,user_id='09d4cfb5f340443d80691ba8ebe62160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276ccbc1-2ac8-44cf-9970-1e8520d6cf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276ccbc1-2ac8-44cf-9970-1e8520d6cf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299171f2-dfec-4e2a-a0f5-5c12f8568078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299171f2-dfec-4e2a-a0f5-5c12f8568078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a51fc31-938b-41b4-90a1-19f1a99986c1', 'volume_name': 'volume-9a51fc31-938b-41b4-90a1-19f1a99986c1', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51188a89-b3f3-4f46-95fc-746dc7dc461a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51188a89-b3f3-4f46-95fc-746dc7dc461a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a30f45-08fb-4be8-aaf9-40b904a8d0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Volume 9a51fc31-938b-41b4-90a1-19f1a99986c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a51fc31-938b-41b4-90a1-19f1a99986c1', 'volume_size': 1} Feb 27 02:08:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:04 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66 1073741824" returned: 0 in 0.898s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:04 devstack sudo[87719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66 Feb 27 02:08:04 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:04 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66" returned: 0 in 0.595s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.871s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-874925155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b61855f-af1d-4cc1-b801-d9926657f468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d419c9c9b44d7ea4077b1c7902597b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:03Z,use_quota=True,user_id='09d4cfb5f340443d80691ba8ebe62160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Creating volume 9b61855f-af1d-4cc1-b801-d9926657f468 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:04 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:08:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9b61855f-af1d-4cc1-b801-d9926657f468 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:04 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9b61855f-af1d-4cc1-b801-d9926657f468 1073741824 Feb 27 02:08:04 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab44c46-cbf6-4276-b63e-b3100f14eac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f8ee95-444a-4ca7-9fcb-4f0389d433ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:04 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Volume volume-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66 (8b71f060-78c8-4b03-b2fc-82ef0dd2cd66): created successfully Feb 27 02:08:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f8ee95-444a-4ca7-9fcb-4f0389d433ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Flow 'volume_create_manager' (961c8a25-7282-40b3-9659-73c2258f637b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:04 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-1ccf716d-8f30-4620-9249-3fa9baba1d64 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Created volume successfully. Feb 27 02:08:05 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9b61855f-af1d-4cc1-b801-d9926657f468 1073741824" returned: 0 in 0.763s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9b61855f-af1d-4cc1-b801-d9926657f468 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:05 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9b61855f-af1d-4cc1-b801-d9926657f468 Feb 27 02:08:05 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:06 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9b61855f-af1d-4cc1-b801-d9926657f468" returned: 0 in 0.712s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:06 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.167s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:06 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1880995438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5bfa606-2a4e-4d52-b9e6-39d08c612b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d419c9c9b44d7ea4077b1c7902597b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:03Z,use_quota=True,user_id='09d4cfb5f340443d80691ba8ebe62160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:06 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Creating volume d5bfa606-2a4e-4d52-b9e6-39d08c612b54 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:06 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:06 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:06 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:06 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:08:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d5bfa606-2a4e-4d52-b9e6-39d08c612b54 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8766370-29ce-4720-813b-da295a4fff8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b61855f-af1d-4cc1-b801-d9926657f468', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:06 devstack sudo[87730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d5bfa606-2a4e-4d52-b9e6-39d08c612b54 1073741824 Feb 27 02:08:06 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9edd11-a868-4dfd-8888-0e1e99c5eff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:06 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Volume volume-9b61855f-af1d-4cc1-b801-d9926657f468 (9b61855f-af1d-4cc1-b801-d9926657f468): created successfully Feb 27 02:08:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9edd11-a868-4dfd-8888-0e1e99c5eff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Flow 'volume_create_manager' (c13c7207-b647-4dcb-bfa5-d2c5b4841679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:06 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-5b19f9e9-92f0-4105-b641-68078e16d7a2 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Created volume successfully. Feb 27 02:08:07 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d5bfa606-2a4e-4d52-b9e6-39d08c612b54 1073741824" returned: 0 in 0.798s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d5bfa606-2a4e-4d52-b9e6-39d08c612b54 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:07 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d5bfa606-2a4e-4d52-b9e6-39d08c612b54 Feb 27 02:08:07 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:07 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d5bfa606-2a4e-4d52-b9e6-39d08c612b54" returned: 0 in 0.575s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.320s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-735972587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd8d1e95-34b3-4f07-9638-79e33fab6f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d419c9c9b44d7ea4077b1c7902597b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:03Z,use_quota=True,user_id='09d4cfb5f340443d80691ba8ebe62160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Creating volume bd8d1e95-34b3-4f07-9638-79e33fab6f79 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:07 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:08:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-bd8d1e95-34b3-4f07-9638-79e33fab6f79 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711270ab-a2c0-477e-8d21-e1db11611878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5bfa606-2a4e-4d52-b9e6-39d08c612b54', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a3ba4b-c3b3-4eeb-86f4-2bc4b3a8f7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:07 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Volume volume-d5bfa606-2a4e-4d52-b9e6-39d08c612b54 (d5bfa606-2a4e-4d52-b9e6-39d08c612b54): created successfully Feb 27 02:08:07 devstack sudo[87738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-bd8d1e95-34b3-4f07-9638-79e33fab6f79 1073741824 Feb 27 02:08:07 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a3ba4b-c3b3-4eeb-86f4-2bc4b3a8f7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Flow 'volume_create_manager' (97f2445d-4b4a-4150-86e3-9e743d2f4bcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:07 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-88ef3a29-cf21-4b01-a498-c2f123ed73ff tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Created volume successfully. Feb 27 02:08:08 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-bd8d1e95-34b3-4f07-9638-79e33fab6f79 1073741824" returned: 0 in 0.875s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-bd8d1e95-34b3-4f07-9638-79e33fab6f79 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:08 devstack sudo[87746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-bd8d1e95-34b3-4f07-9638-79e33fab6f79 Feb 27 02:08:08 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:09 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-bd8d1e95-34b3-4f07-9638-79e33fab6f79" returned: 0 in 0.619s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f92c7c9e-5be7-4766-ab20-c6bf9c83111c tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.586s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3509a96f-67fd-4721-8dfe-d4998a251945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd8d1e95-34b3-4f07-9638-79e33fab6f79', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (942271a0-fb8f-49d3-8171-8126675ba4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-f92c7c9e-5be7-4766-ab20-c6bf9c83111c tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Creating offline snapshot 2b335459-262e-4e65-9fcd-9ac805eb6dba of volume 13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:09 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Volume volume-bd8d1e95-34b3-4f07-9638-79e33fab6f79 (bd8d1e95-34b3-4f07-9638-79e33fab6f79): created successfully Feb 27 02:08:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (942271a0-fb8f-49d3-8171-8126675ba4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Flow 'volume_create_manager' (f67e5c21-b0ed-458f-9ea2-b41e873dc591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:09 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[2237ea98-bb75-4df9-981e-5f56b2e9485c]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f92c7c9e-5be7-4766-ab20-c6bf9c83111c tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:09 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-ccd5a07f-4d32-4160-a9a8-f0e1881d1bd4 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Created volume successfully. Feb 27 02:08:09 devstack sudo[87749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2 Feb 27 02:08:09 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:10 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f92c7c9e-5be7-4766-ab20-c6bf9c83111c tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2" returned: 0 in 0.736s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f92c7c9e-5be7-4766-ab20-c6bf9c83111c tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.2b335459-262e-4e65-9fcd-9ac805eb6dba 2G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:10 devstack sudo[87754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.2b335459-262e-4e65-9fcd-9ac805eb6dba 2G Feb 27 02:08:10 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:10 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f92c7c9e-5be7-4766-ab20-c6bf9c83111c tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.2b335459-262e-4e65-9fcd-9ac805eb6dba 2G" returned: 0 in 0.716s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f92c7c9e-5be7-4766-ab20-c6bf9c83111c tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.2b335459-262e-4e65-9fcd-9ac805eb6dba {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:10 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.2b335459-262e-4e65-9fcd-9ac805eb6dba Feb 27 02:08:10 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:11 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f92c7c9e-5be7-4766-ab20-c6bf9c83111c tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.2b335459-262e-4e65-9fcd-9ac805eb6dba" returned: 0 in 0.677s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:11 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-f92c7c9e-5be7-4766-ab20-c6bf9c83111c tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.2b335459-262e-4e65-9fcd-9ac805eb6dba is being set with open permissions: ugo+rw Feb 27 02:08:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f92c7c9e-5be7-4766-ab20-c6bf9c83111c tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.2b335459-262e-4e65-9fcd-9ac805eb6dba {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:11 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.2b335459-262e-4e65-9fcd-9ac805eb6dba Feb 27 02:08:11 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:11 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f92c7c9e-5be7-4766-ab20-c6bf9c83111c tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.2b335459-262e-4e65-9fcd-9ac805eb6dba" returned: 0 in 0.536s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f92c7c9e-5be7-4766-ab20-c6bf9c83111c tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:12 devstack sudo[87768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.info Feb 27 02:08:12 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:12 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f92c7c9e-5be7-4766-ab20-c6bf9c83111c tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.info" returned: 0 in 0.580s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:12 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-f92c7c9e-5be7-4766-ab20-c6bf9c83111c tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.info is being set with open permissions: ugo+rw Feb 27 02:08:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f92c7c9e-5be7-4766-ab20-c6bf9c83111c tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:12 devstack sudo[87771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.info Feb 27 02:08:12 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:13 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f92c7c9e-5be7-4766-ab20-c6bf9c83111c tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.info" returned: 0 in 0.540s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f92c7c9e-5be7-4766-ab20-c6bf9c83111c tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.923s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.301s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1181548889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a51fc31-938b-41b4-90a1-19f1a99986c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d419c9c9b44d7ea4077b1c7902597b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:04Z,use_quota=True,user_id='09d4cfb5f340443d80691ba8ebe62160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Creating volume 9a51fc31-938b-41b4-90a1-19f1a99986c1 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:13 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:08:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9a51fc31-938b-41b4-90a1-19f1a99986c1 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:13 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9a51fc31-938b-41b4-90a1-19f1a99986c1 1073741824 Feb 27 02:08:13 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:13 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-f92c7c9e-5be7-4766-ab20-c6bf9c83111c tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Create snapshot completed successfully Feb 27 02:08:14 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9a51fc31-938b-41b4-90a1-19f1a99986c1 1073741824" returned: 0 in 0.871s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9a51fc31-938b-41b4-90a1-19f1a99986c1 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:14 devstack sudo[87779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9a51fc31-938b-41b4-90a1-19f1a99986c1 Feb 27 02:08:14 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:14 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Acquiring lock "cinder-2b335459-262e-4e65-9fcd-9ac805eb6dba-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:14 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Lock "cinder-2b335459-262e-4e65-9fcd-9ac805eb6dba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:14 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Acquiring lock "cinder-quobyte-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:14 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Lock "cinder-quobyte-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:14 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Acquiring lock "cinder-quobyte-2b335459-262e-4e65-9fcd-9ac805eb6dba" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:14 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Lock "cinder-quobyte-2b335459-262e-4e65-9fcd-9ac805eb6dba" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:14 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Deleting offline snapshot 2b335459-262e-4e65-9fcd-9ac805eb6dba of volume 13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:08:14 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] snapshot_file for this snap is: volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.2b335459-262e-4e65-9fcd-9ac805eb6dba {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:08:14 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e32d5e4-6bb7-4849-a860-c95bbd42b011]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.2b335459-262e-4e65-9fcd-9ac805eb6dba {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:14 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.2b335459-262e-4e65-9fcd-9ac805eb6dba Feb 27 02:08:14 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:14 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.2b335459-262e-4e65-9fcd-9ac805eb6dba" returned: 0 in 0.696s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:14 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:14 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[1784b181-dddc-4ada-b314-b945e0a1e5ae]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:15 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9a51fc31-938b-41b4-90a1-19f1a99986c1" returned: 0 in 0.968s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:15 devstack sudo[87787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2 Feb 27 02:08:15 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a30f45-08fb-4be8-aaf9-40b904a8d0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a51fc31-938b-41b4-90a1-19f1a99986c1', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d063e972-eab7-40f6-b138-5df8cfbeaa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:15 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Volume volume-9a51fc31-938b-41b4-90a1-19f1a99986c1 (9a51fc31-938b-41b4-90a1-19f1a99986c1): created successfully Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d063e972-eab7-40f6-b138-5df8cfbeaa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Flow 'volume_create_manager' (f1d38cb2-6831-4d6d-b753-d525b0f5bb06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:15 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-0b12b235-8eb4-4b8c-a980-be11c8701619 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Created volume successfully. Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Flow 'volume_create_manager' (a679035b-df18-4e70-8da9-ea609a802292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb0cbc3-065c-4f0e-87fc-479d410601cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb0cbc3-065c-4f0e-87fc-479d410601cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-123998369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a0492d-017c-4446-88ee-0d4755a74a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31f4bf02da240efb07692eb11920ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:15Z,use_quota=True,user_id='144de0574cb04775b842d47dead21501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb15f588-e4be-462b-bc2e-9995272a25ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb15f588-e4be-462b-bc2e-9995272a25ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acccbd84-fa45-42c4-87e3-e8b98c6b2c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acccbd84-fa45-42c4-87e3-e8b98c6b2c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00a0492d-017c-4446-88ee-0d4755a74a0e', 'volume_name': 'volume-00a0492d-017c-4446-88ee-0d4755a74a0e', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02b4b05-10c4-46eb-894f-df238db61458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02b4b05-10c4-46eb-894f-df238db61458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef3e8ae-c17b-424e-ac4f-869f6f153197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:15 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Volume 00a0492d-017c-4446-88ee-0d4755a74a0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00a0492d-017c-4446-88ee-0d4755a74a0e', 'volume_size': 1} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-123998369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a0492d-017c-4446-88ee-0d4755a74a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31f4bf02da240efb07692eb11920ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:15Z,use_quota=True,user_id='144de0574cb04775b842d47dead21501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Creating volume 00a0492d-017c-4446-88ee-0d4755a74a0e {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:15 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:15 devstack sudo[87789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e 1073741824 Feb 27 02:08:15 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:15 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2" returned: 0 in 0.841s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.2b335459-262e-4e65-9fcd-9ac805eb6dba {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:15 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.2b335459-262e-4e65-9fcd-9ac805eb6dba Feb 27 02:08:15 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-da6e7078-d08d-4eac-9036-900aa69d51dc tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "cinder-9a51fc31-938b-41b4-90a1-19f1a99986c1-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-da6e7078-d08d-4eac-9036-900aa69d51dc tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-9a51fc31-938b-41b4-90a1-19f1a99986c1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:16 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-da6e7078-d08d-4eac-9036-900aa69d51dc tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "cinder-quobyte-9a51fc31-938b-41b4-90a1-19f1a99986c1" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:16 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-da6e7078-d08d-4eac-9036-900aa69d51dc tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-quobyte-9a51fc31-938b-41b4-90a1-19f1a99986c1" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:16 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bc32ab-50f5-406d-bade-314501c065b7]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-da6e7078-d08d-4eac-9036-900aa69d51dc tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9a51fc31-938b-41b4-90a1-19f1a99986c1 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:16 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e 1073741824" returned: 0 in 0.822s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:16 devstack sudo[87808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9a51fc31-938b-41b4-90a1-19f1a99986c1 Feb 27 02:08:16 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:16 devstack sudo[87809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e Feb 27 02:08:16 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:16 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.2b335459-262e-4e65-9fcd-9ac805eb6dba" returned: 0 in 0.892s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.2b335459-262e-4e65-9fcd-9ac805eb6dba {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:16 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.2b335459-262e-4e65-9fcd-9ac805eb6dba Feb 27 02:08:16 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:16 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e" returned: 0 in 0.665s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:16 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef3e8ae-c17b-424e-ac4f-869f6f153197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00a0492d-017c-4446-88ee-0d4755a74a0e', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:16 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756c90e4-56e6-49c0-a8f2-ecfda6827a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:16 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:16 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Volume volume-00a0492d-017c-4446-88ee-0d4755a74a0e (00a0492d-017c-4446-88ee-0d4755a74a0e): created successfully Feb 27 02:08:16 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756c90e4-56e6-49c0-a8f2-ecfda6827a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:16 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Flow 'volume_create_manager' (a679035b-df18-4e70-8da9-ea609a802292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-da6e7078-d08d-4eac-9036-900aa69d51dc tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9a51fc31-938b-41b4-90a1-19f1a99986c1" returned: 0 in 0.824s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-da6e7078-d08d-4eac-9036-900aa69d51dc tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9a51fc31-938b-41b4-90a1-19f1a99986c1 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:16 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-d451b954-4b24-4533-ac92-0d6c1725c25d tempest-VolumesSnapshotTestJSON-503274425 None] Created volume successfully. Feb 27 02:08:16 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9a51fc31-938b-41b4-90a1-19f1a99986c1 Feb 27 02:08:16 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:17 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2.2b335459-262e-4e65-9fcd-9ac805eb6dba" returned: 0 in 0.545s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:17 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Lock "cinder-quobyte-2b335459-262e-4e65-9fcd-9ac805eb6dba" released by "_delete_snapshot" :: held 3.039s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:17 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Lock "cinder-quobyte-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2" released by "delete_snapshot" :: held 3.057s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:17 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Created reservations ['c1ac090a-2ae8-4fb5-807f-6dfae6f7bd9a', '4020835d-c36c-4597-b02b-a77b142ad892', 'bd7198fc-c2a0-47a7-9bac-80204aa4eebd', 'c729d606-4eb3-471b-bbbd-b9714b31cdff'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:17 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Delete snapshot completed successfully. Feb 27 02:08:17 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5bfbb88e-aaa5-44b3-a4df-3d04fb7e9cde tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Lock "cinder-2b335459-262e-4e65-9fcd-9ac805eb6dba-delete_snapshot" released by "delete_snapshot" :: held 3.218s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:17 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-da6e7078-d08d-4eac-9036-900aa69d51dc tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9a51fc31-938b-41b4-90a1-19f1a99986c1" returned: 0 in 0.557s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:17 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-da6e7078-d08d-4eac-9036-900aa69d51dc tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-quobyte-9a51fc31-938b-41b4-90a1-19f1a99986c1" released by "delete_volume" :: held 1.417s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:17 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-da6e7078-d08d-4eac-9036-900aa69d51dc tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Created reservations ['074faca1-876e-4392-89bc-add08d801b48', '84421e8a-0e6e-467d-be05-1d028907428a', '17cc952c-9002-439b-9a09-94fdc2938615', '5f3e9a1b-eb4f-4dc6-9f0b-92b1ac3b35d4'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-da6e7078-d08d-4eac-9036-900aa69d51dc tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-da6e7078-d08d-4eac-9036-900aa69d51dc tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:17 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-da6e7078-d08d-4eac-9036-900aa69d51dc tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:17 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-da6e7078-d08d-4eac-9036-900aa69d51dc tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-da6e7078-d08d-4eac-9036-900aa69d51dc tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-da6e7078-d08d-4eac-9036-900aa69d51dc tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:17 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:08:17 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-64a4e071-3276-4959-990f-f23b65dfef5f tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-64a4e071-3276-4959-990f-f23b65dfef5f tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:17 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-64a4e071-3276-4959-990f-f23b65dfef5f tempest-VolumesSnapshotTestJSON-503274425 None] Creating offline snapshot ccaecd33-53bd-416b-9be7-f2a4c0278672 of volume 00a0492d-017c-4446-88ee-0d4755a74a0e {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:17 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4d6b50-7b53-4f38-b95b-ebd4198d5a12]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-64a4e071-3276-4959-990f-f23b65dfef5f tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:17 devstack sudo[87829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e Feb 27 02:08:17 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:18 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-da6e7078-d08d-4eac-9036-900aa69d51dc tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.515s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:18 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-da6e7078-d08d-4eac-9036-900aa69d51dc tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:18 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-da6e7078-d08d-4eac-9036-900aa69d51dc tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Deleted volume successfully. Feb 27 02:08:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-da6e7078-d08d-4eac-9036-900aa69d51dc tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-9a51fc31-938b-41b4-90a1-19f1a99986c1-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e7cc7492-9c84-4f74-8a20-d767de40b568 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "cinder-bd8d1e95-34b3-4f07-9638-79e33fab6f79-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e7cc7492-9c84-4f74-8a20-d767de40b568 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-bd8d1e95-34b3-4f07-9638-79e33fab6f79-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:18 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-64a4e071-3276-4959-990f-f23b65dfef5f tempest-VolumesSnapshotTestJSON-503274425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e" returned: 0 in 0.600s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-64a4e071-3276-4959-990f-f23b65dfef5f tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.ccaecd33-53bd-416b-9be7-f2a4c0278672 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:18 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.ccaecd33-53bd-416b-9be7-f2a4c0278672 1G Feb 27 02:08:18 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e7cc7492-9c84-4f74-8a20-d767de40b568 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "cinder-quobyte-bd8d1e95-34b3-4f07-9638-79e33fab6f79" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e7cc7492-9c84-4f74-8a20-d767de40b568 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-quobyte-bd8d1e95-34b3-4f07-9638-79e33fab6f79" acquired by "delete_volume" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:18 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cefc98-f08b-48cd-b601-5a00e3c95d53]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e7cc7492-9c84-4f74-8a20-d767de40b568 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-bd8d1e95-34b3-4f07-9638-79e33fab6f79 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:18 devstack sudo[87837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-bd8d1e95-34b3-4f07-9638-79e33fab6f79 Feb 27 02:08:18 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-509e6956-9c72-497e-93d3-33405a70896f tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Acquiring lock "cinder-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-509e6956-9c72-497e-93d3-33405a70896f tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Lock "cinder-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-509e6956-9c72-497e-93d3-33405a70896f tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Acquiring lock "cinder-quobyte-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-509e6956-9c72-497e-93d3-33405a70896f tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Lock "cinder-quobyte-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2" acquired by "delete_volume" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:18 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7d5b4f-cfa6-4c00-9a4f-2b2abd00119b]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-509e6956-9c72-497e-93d3-33405a70896f tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:18 devstack sudo[87871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2 Feb 27 02:08:18 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:19 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-64a4e071-3276-4959-990f-f23b65dfef5f tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.ccaecd33-53bd-416b-9be7-f2a4c0278672 1G" returned: 0 in 0.791s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-64a4e071-3276-4959-990f-f23b65dfef5f tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00a0492d-017c-4446-88ee-0d4755a74a0e -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.ccaecd33-53bd-416b-9be7-f2a4c0278672 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:19 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00a0492d-017c-4446-88ee-0d4755a74a0e -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.ccaecd33-53bd-416b-9be7-f2a4c0278672 Feb 27 02:08:19 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:19 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e7cc7492-9c84-4f74-8a20-d767de40b568 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-bd8d1e95-34b3-4f07-9638-79e33fab6f79" returned: 0 in 0.763s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e7cc7492-9c84-4f74-8a20-d767de40b568 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-bd8d1e95-34b3-4f07-9638-79e33fab6f79 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:19 devstack sudo[87883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-bd8d1e95-34b3-4f07-9638-79e33fab6f79 Feb 27 02:08:19 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:19 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-509e6956-9c72-497e-93d3-33405a70896f tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2" returned: 0 in 0.677s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-509e6956-9c72-497e-93d3-33405a70896f tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:19 devstack sudo[87888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2 Feb 27 02:08:19 devstack sudo[87888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:19 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-64a4e071-3276-4959-990f-f23b65dfef5f tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00a0492d-017c-4446-88ee-0d4755a74a0e -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.ccaecd33-53bd-416b-9be7-f2a4c0278672" returned: 0 in 0.540s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:19 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-64a4e071-3276-4959-990f-f23b65dfef5f tempest-VolumesSnapshotTestJSON-503274425 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.ccaecd33-53bd-416b-9be7-f2a4c0278672 is being set with open permissions: ugo+rw Feb 27 02:08:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-64a4e071-3276-4959-990f-f23b65dfef5f tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.ccaecd33-53bd-416b-9be7-f2a4c0278672 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:19 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.ccaecd33-53bd-416b-9be7-f2a4c0278672 Feb 27 02:08:19 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:19 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e7cc7492-9c84-4f74-8a20-d767de40b568 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-bd8d1e95-34b3-4f07-9638-79e33fab6f79" returned: 0 in 0.575s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:19 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e7cc7492-9c84-4f74-8a20-d767de40b568 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-quobyte-bd8d1e95-34b3-4f07-9638-79e33fab6f79" released by "delete_volume" :: held 1.379s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:19 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-e7cc7492-9c84-4f74-8a20-d767de40b568 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Created reservations ['b1c14f8a-eda8-4f56-bb1c-401e64b2ca29', 'acec01cd-8721-48a3-882d-2a9ce6a9e84e', 'fb66fba1-a845-46e7-bd06-deb3aba22771', 'd07da6f0-3888-455e-ac10-95e4d5345d5a'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e7cc7492-9c84-4f74-8a20-d767de40b568 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e7cc7492-9c84-4f74-8a20-d767de40b568 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:19 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e7cc7492-9c84-4f74-8a20-d767de40b568 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:19 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e7cc7492-9c84-4f74-8a20-d767de40b568 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e7cc7492-9c84-4f74-8a20-d767de40b568 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e7cc7492-9c84-4f74-8a20-d767de40b568 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:19 devstack sudo[87896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:08:19 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:19 devstack sudo[87888]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-509e6956-9c72-497e-93d3-33405a70896f tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2" returned: 0 in 0.533s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:19 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-509e6956-9c72-497e-93d3-33405a70896f tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Lock "cinder-quobyte-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2" released by "delete_volume" :: held 1.256s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-509e6956-9c72-497e-93d3-33405a70896f tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Created reservations ['0a44f8b0-246d-4f6f-9241-d457d4b865f1', '161aa54b-d2cd-4298-bf52-d5f328d1bfff', 'd2ad22b5-4dc8-4b47-b12a-6cf5b40aa3df', '08967a6a-5846-463e-9067-9929ce6bd32b'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:20 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-64a4e071-3276-4959-990f-f23b65dfef5f tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.ccaecd33-53bd-416b-9be7-f2a4c0278672" returned: 0 in 0.497s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-509e6956-9c72-497e-93d3-33405a70896f tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-509e6956-9c72-497e-93d3-33405a70896f tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-509e6956-9c72-497e-93d3-33405a70896f tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-509e6956-9c72-497e-93d3-33405a70896f tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-509e6956-9c72-497e-93d3-33405a70896f tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-509e6956-9c72-497e-93d3-33405a70896f tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:20 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:08:20 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-64a4e071-3276-4959-990f-f23b65dfef5f tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:20 devstack sudo[87902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.info Feb 27 02:08:20 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:20 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e7cc7492-9c84-4f74-8a20-d767de40b568 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.554s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-e7cc7492-9c84-4f74-8a20-d767de40b568 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:20 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e7cc7492-9c84-4f74-8a20-d767de40b568 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Deleted volume successfully. Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e7cc7492-9c84-4f74-8a20-d767de40b568 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-bd8d1e95-34b3-4f07-9638-79e33fab6f79-delete_volume" released by "delete_volume" :: held 2.188s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-2302486c-6db1-4adf-b5ba-094acf64d299 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "cinder-d5bfa606-2a4e-4d52-b9e6-39d08c612b54-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-2302486c-6db1-4adf-b5ba-094acf64d299 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-d5bfa606-2a4e-4d52-b9e6-39d08c612b54-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-2302486c-6db1-4adf-b5ba-094acf64d299 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "cinder-quobyte-d5bfa606-2a4e-4d52-b9e6-39d08c612b54" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-2302486c-6db1-4adf-b5ba-094acf64d299 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-quobyte-d5bfa606-2a4e-4d52-b9e6-39d08c612b54" acquired by "delete_volume" :: waited 0.008s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[a353acd7-8300-4c23-b965-3e20cbc83b10]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2302486c-6db1-4adf-b5ba-094acf64d299 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d5bfa606-2a4e-4d52-b9e6-39d08c612b54 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:20 devstack sudo[87907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d5bfa606-2a4e-4d52-b9e6-39d08c612b54 Feb 27 02:08:20 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:20 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-509e6956-9c72-497e-93d3-33405a70896f tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.667s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-509e6956-9c72-497e-93d3-33405a70896f tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:20 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-509e6956-9c72-497e-93d3-33405a70896f tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Deleted volume successfully. Feb 27 02:08:20 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-64a4e071-3276-4959-990f-f23b65dfef5f tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.info" returned: 0 in 0.690s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-509e6956-9c72-497e-93d3-33405a70896f tempest-VolumesSnapshotNegativeTestJSON-1684122158 None] Lock "cinder-13cf714b-5ebd-49cc-a3c5-fca67d0ce6f2-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:20 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-64a4e071-3276-4959-990f-f23b65dfef5f tempest-VolumesSnapshotTestJSON-503274425 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.info is being set with open permissions: ugo+rw Feb 27 02:08:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-64a4e071-3276-4959-990f-f23b65dfef5f tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:20 devstack sudo[87910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.info Feb 27 02:08:20 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:21 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2302486c-6db1-4adf-b5ba-094acf64d299 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d5bfa606-2a4e-4d52-b9e6-39d08c612b54" returned: 0 in 0.639s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2302486c-6db1-4adf-b5ba-094acf64d299 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d5bfa606-2a4e-4d52-b9e6-39d08c612b54 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:21 devstack sudo[87916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d5bfa606-2a4e-4d52-b9e6-39d08c612b54 Feb 27 02:08:21 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:21 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-64a4e071-3276-4959-990f-f23b65dfef5f tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.info" returned: 0 in 0.702s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-64a4e071-3276-4959-990f-f23b65dfef5f tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.928s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:21 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-64a4e071-3276-4959-990f-f23b65dfef5f tempest-VolumesSnapshotTestJSON-503274425 None] Create snapshot completed successfully Feb 27 02:08:21 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2302486c-6db1-4adf-b5ba-094acf64d299 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d5bfa606-2a4e-4d52-b9e6-39d08c612b54" returned: 0 in 0.568s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:21 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-2302486c-6db1-4adf-b5ba-094acf64d299 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-quobyte-d5bfa606-2a4e-4d52-b9e6-39d08c612b54" released by "delete_volume" :: held 1.237s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:21 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-2302486c-6db1-4adf-b5ba-094acf64d299 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Created reservations ['0538c33b-2ad3-4036-9c6b-23d9e4aaea5d', '5924b257-68d7-4785-9e65-3151144f04c6', '3c421170-2482-4a36-a8ae-f05286315af8', '7ef89b50-d846-4381-bf9b-516b3f1bbdba'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2302486c-6db1-4adf-b5ba-094acf64d299 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2302486c-6db1-4adf-b5ba-094acf64d299 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:21 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-2302486c-6db1-4adf-b5ba-094acf64d299 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:21 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-2302486c-6db1-4adf-b5ba-094acf64d299 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-2302486c-6db1-4adf-b5ba-094acf64d299 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2302486c-6db1-4adf-b5ba-094acf64d299 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:21 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:08:21 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-ccaecd33-53bd-416b-9be7-f2a4c0278672-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-ccaecd33-53bd-416b-9be7-f2a4c0278672-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-quobyte-00a0492d-017c-4446-88ee-0d4755a74a0e" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-00a0492d-017c-4446-88ee-0d4755a74a0e" acquired by "delete_snapshot" :: waited 0.032s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-quobyte-ccaecd33-53bd-416b-9be7-f2a4c0278672" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-ccaecd33-53bd-416b-9be7-f2a4c0278672" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:22 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] Deleting offline snapshot ccaecd33-53bd-416b-9be7-f2a4c0278672 of volume 00a0492d-017c-4446-88ee-0d4755a74a0e {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:08:22 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] snapshot_file for this snap is: volume-00a0492d-017c-4446-88ee-0d4755a74a0e.ccaecd33-53bd-416b-9be7-f2a4c0278672 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:08:22 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[40963f2b-10f6-4afc-b30e-0ba451a9f74f]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.ccaecd33-53bd-416b-9be7-f2a4c0278672 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:22 devstack sudo[87923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.ccaecd33-53bd-416b-9be7-f2a4c0278672 Feb 27 02:08:22 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:22 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-2302486c-6db1-4adf-b5ba-094acf64d299 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.655s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:22 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-2302486c-6db1-4adf-b5ba-094acf64d299 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:22 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-2302486c-6db1-4adf-b5ba-094acf64d299 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Deleted volume successfully. Feb 27 02:08:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-2302486c-6db1-4adf-b5ba-094acf64d299 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-d5bfa606-2a4e-4d52-b9e6-39d08c612b54-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fa42152a-e618-4edb-b403-4cb7a8d49a19 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "cinder-9b61855f-af1d-4cc1-b801-d9926657f468-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fa42152a-e618-4edb-b403-4cb7a8d49a19 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-9b61855f-af1d-4cc1-b801-d9926657f468-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fa42152a-e618-4edb-b403-4cb7a8d49a19 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "cinder-quobyte-9b61855f-af1d-4cc1-b801-d9926657f468" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fa42152a-e618-4edb-b403-4cb7a8d49a19 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-quobyte-9b61855f-af1d-4cc1-b801-d9926657f468" acquired by "delete_volume" :: waited 0.015s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:22 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[7034aa54-a538-4411-8ddf-0c292eef85db]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fa42152a-e618-4edb-b403-4cb7a8d49a19 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9b61855f-af1d-4cc1-b801-d9926657f468 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:22 devstack sudo[87935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9b61855f-af1d-4cc1-b801-d9926657f468 Feb 27 02:08:22 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:23 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.ccaecd33-53bd-416b-9be7-f2a4c0278672" returned: 0 in 0.878s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00a0492d-017c-4446-88ee-0d4755a74a0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:23 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1f07ab-4521-46ab-985f-24f9cb88171c]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:23 devstack sudo[87945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e Feb 27 02:08:23 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:23 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fa42152a-e618-4edb-b403-4cb7a8d49a19 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9b61855f-af1d-4cc1-b801-d9926657f468" returned: 0 in 0.739s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fa42152a-e618-4edb-b403-4cb7a8d49a19 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9b61855f-af1d-4cc1-b801-d9926657f468 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:23 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9b61855f-af1d-4cc1-b801-d9926657f468 Feb 27 02:08:23 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:23 devstack cinder-volume[82738]: DEBUG oslo_service.periodic_task [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82738) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:08:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:23 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:08:23 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:23 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e" returned: 0 in 0.784s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.ccaecd33-53bd-416b-9be7-f2a4c0278672 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:24 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.ccaecd33-53bd-416b-9be7-f2a4c0278672 Feb 27 02:08:24 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:24 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fa42152a-e618-4edb-b403-4cb7a8d49a19 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9b61855f-af1d-4cc1-b801-d9926657f468" returned: 0 in 0.597s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:24 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fa42152a-e618-4edb-b403-4cb7a8d49a19 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-quobyte-9b61855f-af1d-4cc1-b801-d9926657f468" released by "delete_volume" :: held 1.364s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:24 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-fa42152a-e618-4edb-b403-4cb7a8d49a19 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Created reservations ['93c342f4-50ba-4dab-9e73-bbccbde845df', '5bb12a94-cd88-47b9-8e68-d518b9c7f338', '3fa8da3b-cc87-4db7-9686-143fc7b84d45', 'd655e2ef-255d-4b6d-8002-49df0fcf6253'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:24 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.597s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:24 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fa42152a-e618-4edb-b403-4cb7a8d49a19 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fa42152a-e618-4edb-b403-4cb7a8d49a19 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:24 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-fa42152a-e618-4edb-b403-4cb7a8d49a19 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:24 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-fa42152a-e618-4edb-b403-4cb7a8d49a19 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fa42152a-e618-4edb-b403-4cb7a8d49a19 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fa42152a-e618-4edb-b403-4cb7a8d49a19 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:24 devstack sudo[87963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:08:24 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:24 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.ccaecd33-53bd-416b-9be7-f2a4c0278672" returned: 0 in 0.632s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.ccaecd33-53bd-416b-9be7-f2a4c0278672 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:24 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.ccaecd33-53bd-416b-9be7-f2a4c0278672 Feb 27 02:08:24 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:24 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0b370d8-6f1b-44b5-a0be-2db0eee61948 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "cinder-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:24 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0b370d8-6f1b-44b5-a0be-2db0eee61948 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:25 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fa42152a-e618-4edb-b403-4cb7a8d49a19 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.684s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:25 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-fa42152a-e618-4edb-b403-4cb7a8d49a19 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:25 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-fa42152a-e618-4edb-b403-4cb7a8d49a19 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Deleted volume successfully. Feb 27 02:08:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0b370d8-6f1b-44b5-a0be-2db0eee61948 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "cinder-quobyte-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fa42152a-e618-4edb-b403-4cb7a8d49a19 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-9b61855f-af1d-4cc1-b801-d9926657f468-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0b370d8-6f1b-44b5-a0be-2db0eee61948 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-quobyte-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66" acquired by "delete_volume" :: waited 0.018s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:25 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89a17a4-4cd9-4391-8d62-cffec33ad7e9]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e0b370d8-6f1b-44b5-a0be-2db0eee61948 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:25 devstack sudo[87988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66 Feb 27 02:08:25 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:25 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e.ccaecd33-53bd-416b-9be7-f2a4c0278672" returned: 0 in 0.565s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-ccaecd33-53bd-416b-9be7-f2a4c0278672" released by "_delete_snapshot" :: held 2.953s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-00a0492d-017c-4446-88ee-0d4755a74a0e" released by "delete_snapshot" :: held 2.971s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:25 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] Created reservations ['9550bc44-1052-4ba4-8057-72cf997c2dca', '6c0c931b-148f-4cd8-abb7-4db34cd1b4ce', 'beb9e6d0-fc49-4e0a-ae7c-20987f6de374', '42766dc9-0d75-4cbf-bdba-369b39e1308e'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:25 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] Delete snapshot completed successfully. Feb 27 02:08:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-210ca2e0-2658-4f59-8c30-ae96df0fb9e0 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-ccaecd33-53bd-416b-9be7-f2a4c0278672-delete_snapshot" released by "delete_snapshot" :: held 3.165s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:25 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e0b370d8-6f1b-44b5-a0be-2db0eee61948 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66" returned: 0 in 0.573s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e0b370d8-6f1b-44b5-a0be-2db0eee61948 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:25 devstack sudo[87993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66 Feb 27 02:08:25 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:26 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e0b370d8-6f1b-44b5-a0be-2db0eee61948 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66" returned: 0 in 0.527s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0b370d8-6f1b-44b5-a0be-2db0eee61948 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-quobyte-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66" released by "delete_volume" :: held 1.126s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-e0b370d8-6f1b-44b5-a0be-2db0eee61948 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Created reservations ['1a5b7693-9f24-40d4-8569-fecfcb44adeb', '8a86b409-d5df-4720-afd8-fdd3395e339e', '5b9f8f92-9cc5-42a1-ba50-6f555724a2b1', '702af91e-0333-4fb9-8e32-27b7822c8831'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e0b370d8-6f1b-44b5-a0be-2db0eee61948 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e0b370d8-6f1b-44b5-a0be-2db0eee61948 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e0b370d8-6f1b-44b5-a0be-2db0eee61948 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e0b370d8-6f1b-44b5-a0be-2db0eee61948 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e0b370d8-6f1b-44b5-a0be-2db0eee61948 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e0b370d8-6f1b-44b5-a0be-2db0eee61948 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:26 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:08:26 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Flow 'volume_create_manager' (da1f9f02-2692-4fec-ba8a-7c00380bfebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35903760-c4c5-417f-8491-b38cec8e8436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35903760-c4c5-417f-8491-b38cec8e8436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-663438043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e96bca-18e3-4f04-bcda-f072fddd2efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31f4bf02da240efb07692eb11920ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:27Z,use_quota=True,user_id='144de0574cb04775b842d47dead21501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a72638-9bdd-4cda-a06e-62b82ec823fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a72638-9bdd-4cda-a06e-62b82ec823fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:26 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c09c76f-b819-4678-b798-5795f3673c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c09c76f-b819-4678-b798-5795f3673c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4e96bca-18e3-4f04-bcda-f072fddd2efc', 'volume_name': 'volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdcfdf3b-354a-49a9-89ef-412ff3a529c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdcfdf3b-354a-49a9-89ef-412ff3a529c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fbcabd-8e11-4591-ac84-75d1c7d79f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:26 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Volume d4e96bca-18e3-4f04-bcda-f072fddd2efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc', 'volume_size': 1} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-663438043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e96bca-18e3-4f04-bcda-f072fddd2efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31f4bf02da240efb07692eb11920ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:27Z,use_quota=True,user_id='144de0574cb04775b842d47dead21501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Creating volume d4e96bca-18e3-4f04-bcda-f072fddd2efc {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:26 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e0b370d8-6f1b-44b5-a0be-2db0eee61948 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.523s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-e0b370d8-6f1b-44b5-a0be-2db0eee61948 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:26 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e0b370d8-6f1b-44b5-a0be-2db0eee61948 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Deleted volume successfully. Feb 27 02:08:26 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc 1073741824 Feb 27 02:08:26 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:26 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0b370d8-6f1b-44b5-a0be-2db0eee61948 tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-8b71f060-78c8-4b03-b2fc-82ef0dd2cd66-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:27 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5213fd4b-939d-4d0a-a925-2acf6f50b76e tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "cinder-b2295e10-04f7-4b1b-abba-1aaf61a30090-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:27 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5213fd4b-939d-4d0a-a925-2acf6f50b76e tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-b2295e10-04f7-4b1b-abba-1aaf61a30090-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:27 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5213fd4b-939d-4d0a-a925-2acf6f50b76e tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "cinder-quobyte-b2295e10-04f7-4b1b-abba-1aaf61a30090" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:27 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5213fd4b-939d-4d0a-a925-2acf6f50b76e tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-quobyte-b2295e10-04f7-4b1b-abba-1aaf61a30090" acquired by "delete_volume" :: waited 0.017s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:27 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7d611b-1073-4a88-938e-eea3130896e3]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5213fd4b-939d-4d0a-a925-2acf6f50b76e tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b2295e10-04f7-4b1b-abba-1aaf61a30090 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:27 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b2295e10-04f7-4b1b-abba-1aaf61a30090 Feb 27 02:08:27 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:27 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc 1073741824" returned: 0 in 0.654s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:27 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc Feb 27 02:08:27 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:27 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5213fd4b-939d-4d0a-a925-2acf6f50b76e tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b2295e10-04f7-4b1b-abba-1aaf61a30090" returned: 0 in 0.643s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5213fd4b-939d-4d0a-a925-2acf6f50b76e tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b2295e10-04f7-4b1b-abba-1aaf61a30090 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:27 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b2295e10-04f7-4b1b-abba-1aaf61a30090 Feb 27 02:08:27 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:27 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc" returned: 0 in 0.494s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:27 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fbcabd-8e11-4591-ac84-75d1c7d79f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f46701d-1239-44ee-81df-553ab23829e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:27 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Volume volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc (d4e96bca-18e3-4f04-bcda-f072fddd2efc): created successfully Feb 27 02:08:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f46701d-1239-44ee-81df-553ab23829e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Flow 'volume_create_manager' (da1f9f02-2692-4fec-ba8a-7c00380bfebd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:28 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-dc70c29d-c62d-444f-9e2e-8c8e37240642 tempest-VolumesSnapshotTestJSON-503274425 None] Created volume successfully. Feb 27 02:08:28 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5213fd4b-939d-4d0a-a925-2acf6f50b76e tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-b2295e10-04f7-4b1b-abba-1aaf61a30090" returned: 0 in 0.457s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:28 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5213fd4b-939d-4d0a-a925-2acf6f50b76e tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-quobyte-b2295e10-04f7-4b1b-abba-1aaf61a30090" released by "delete_volume" :: held 1.132s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:28 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-5213fd4b-939d-4d0a-a925-2acf6f50b76e tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Created reservations ['adac4976-317c-4e79-8e87-f0bb8adbea25', 'b181bb46-c40b-42f8-85ba-1c5d746c31e7', '099668b7-b0f0-431f-ac36-cd23f6fada28', 'b437de1e-b388-486e-8d28-1af8a4338cdf'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5213fd4b-939d-4d0a-a925-2acf6f50b76e tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5213fd4b-939d-4d0a-a925-2acf6f50b76e tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:28 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5213fd4b-939d-4d0a-a925-2acf6f50b76e tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:28 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5213fd4b-939d-4d0a-a925-2acf6f50b76e tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5213fd4b-939d-4d0a-a925-2acf6f50b76e tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5213fd4b-939d-4d0a-a925-2acf6f50b76e tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:28 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:08:28 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:29 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5213fd4b-939d-4d0a-a925-2acf6f50b76e tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.841s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:29 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-5213fd4b-939d-4d0a-a925-2acf6f50b76e tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d39d7236-b60d-4452-b72d-cc8467aa1c61 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d39d7236-b60d-4452-b72d-cc8467aa1c61 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:29 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-5213fd4b-939d-4d0a-a925-2acf6f50b76e tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Deleted volume successfully. Feb 27 02:08:29 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-d39d7236-b60d-4452-b72d-cc8467aa1c61 tempest-VolumesSnapshotTestJSON-503274425 None] Creating offline snapshot 69918783-1944-485d-ab03-aebf67109cf6 of volume d4e96bca-18e3-4f04-bcda-f072fddd2efc {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:29 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5213fd4b-939d-4d0a-a925-2acf6f50b76e tempest-CreateVolumesFromSourceVolumeTest-1237719271 None] Lock "cinder-b2295e10-04f7-4b1b-abba-1aaf61a30090-delete_volume" released by "delete_volume" :: held 2.161s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:29 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dc3ec7-2045-41c6-938d-33818c9df5f9]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d39d7236-b60d-4452-b72d-cc8467aa1c61 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:29 devstack sudo[88085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc Feb 27 02:08:29 devstack sudo[88085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:30 devstack sudo[88085]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d39d7236-b60d-4452-b72d-cc8467aa1c61 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc" returned: 0 in 0.941s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d39d7236-b60d-4452-b72d-cc8467aa1c61 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:30 devstack sudo[88092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6 1G Feb 27 02:08:30 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:31 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d39d7236-b60d-4452-b72d-cc8467aa1c61 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6 1G" returned: 0 in 0.719s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d39d7236-b60d-4452-b72d-cc8467aa1c61 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:31 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6 Feb 27 02:08:31 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:31 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d39d7236-b60d-4452-b72d-cc8467aa1c61 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6" returned: 0 in 0.845s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:31 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-d39d7236-b60d-4452-b72d-cc8467aa1c61 tempest-VolumesSnapshotTestJSON-503274425 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6 is being set with open permissions: ugo+rw Feb 27 02:08:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d39d7236-b60d-4452-b72d-cc8467aa1c61 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:31 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6 Feb 27 02:08:31 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:32 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Flow 'volume_create_manager' (d3ff531b-81c4-41d4-b77c-e481b66597f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8137786-3400-402f-84ae-0f36b055b192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8137786-3400-402f-84ae-0f36b055b192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-131446932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=198498e9-ce13-44fe-ba3e-960b85720875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072abd4304544ff6982304f57051dff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:32Z,use_quota=True,user_id='379da0d623584a429d6404c08b7a8d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9e0e2a-12d8-4f03-aa53-5a365e143a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9e0e2a-12d8-4f03-aa53-5a365e143a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f3144cd-934a-4651-af3f-c4abb18b4215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f3144cd-934a-4651-af3f-c4abb18b4215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '198498e9-ce13-44fe-ba3e-960b85720875', 'volume_name': 'volume-198498e9-ce13-44fe-ba3e-960b85720875', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124dbc11-f9b0-461c-83ff-383dfe742818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:32 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124dbc11-f9b0-461c-83ff-383dfe742818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8191d564-0ebb-4a8d-93d3-1be78e4a6597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:32 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Volume 198498e9-ce13-44fe-ba3e-960b85720875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-198498e9-ce13-44fe-ba3e-960b85720875', 'volume_size': 1} Feb 27 02:08:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d39d7236-b60d-4452-b72d-cc8467aa1c61 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6" returned: 0 in 0.599s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d39d7236-b60d-4452-b72d-cc8467aa1c61 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:32 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.info Feb 27 02:08:32 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:32 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d39d7236-b60d-4452-b72d-cc8467aa1c61 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.info" returned: 0 in 0.456s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:32 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-d39d7236-b60d-4452-b72d-cc8467aa1c61 tempest-VolumesSnapshotTestJSON-503274425 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.info is being set with open permissions: ugo+rw Feb 27 02:08:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d39d7236-b60d-4452-b72d-cc8467aa1c61 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:32 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.info Feb 27 02:08:32 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:33 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d39d7236-b60d-4452-b72d-cc8467aa1c61 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.info" returned: 0 in 0.632s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d39d7236-b60d-4452-b72d-cc8467aa1c61 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.270s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.134s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-131446932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=198498e9-ce13-44fe-ba3e-960b85720875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072abd4304544ff6982304f57051dff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:32Z,use_quota=True,user_id='379da0d623584a429d6404c08b7a8d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Creating volume 198498e9-ce13-44fe-ba3e-960b85720875 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:33 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:08:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:33 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 1073741824 Feb 27 02:08:33 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-d39d7236-b60d-4452-b72d-cc8467aa1c61 tempest-VolumesSnapshotTestJSON-503274425 None] Create snapshot completed successfully Feb 27 02:08:33 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:34 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 1073741824" returned: 0 in 0.605s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:34 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 Feb 27 02:08:34 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:34 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875" returned: 0 in 0.616s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:34 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:34 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8191d564-0ebb-4a8d-93d3-1be78e4a6597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-198498e9-ce13-44fe-ba3e-960b85720875', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:34 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1711c79e-2840-4129-9aef-81cee235bfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:34 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Volume volume-198498e9-ce13-44fe-ba3e-960b85720875 (198498e9-ce13-44fe-ba3e-960b85720875): created successfully Feb 27 02:08:34 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1711c79e-2840-4129-9aef-81cee235bfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:34 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Flow 'volume_create_manager' (d3ff531b-81c4-41d4-b77c-e481b66597f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:34 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-f4e5c5d5-6f6a-4f29-b274-c59ef9d50dae tempest-VolumeDependencyTests-1173424542 None] Created volume successfully. Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Flow 'volume_create_manager' (d9cd69de-f4c6-4b7b-ad9c-90df281b7a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef0badad-1b7b-4b1b-8a03-98651fd09907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef0badad-1b7b-4b1b-8a03-98651fd09907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1614161894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5432ea-4715-4ec0-abf1-723058744499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31f4bf02da240efb07692eb11920ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=69918783-1944-485d-ab03-aebf67109cf6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:35Z,use_quota=True,user_id='144de0574cb04775b842d47dead21501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f6439b-430a-445a-8ec4-63ca10cd340d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f6439b-430a-445a-8ec4-63ca10cd340d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f9716d-c295-48d0-b50b-c978633929b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f9716d-c295-48d0-b50b-c978633929b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ec5432ea-4715-4ec0-abf1-723058744499', 'volume_name': 'volume-ec5432ea-4715-4ec0-abf1-723058744499', 'volume_size': 2, 'snapshot_id': '69918783-1944-485d-ab03-aebf67109cf6'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd59c32-4edd-4013-bdad-06525bec8a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd59c32-4edd-4013-bdad-06525bec8a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef8fb2c5-bc6b-4af8-8ce3-bf0c96dffe2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:35 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Volume ec5432ea-4715-4ec0-abf1-723058744499: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ec5432ea-4715-4ec0-abf1-723058744499', 'volume_size': 2, 'snapshot_id': '69918783-1944-485d-ab03-aebf67109cf6'} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-quobyte-69918783-1944-485d-ab03-aebf67109cf6-ec5432ea-4715-4ec0-abf1-723058744499" by "_create_volume_from_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-69918783-1944-485d-ab03-aebf67109cf6-ec5432ea-4715-4ec0-abf1-723058744499" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Creating volume ec5432ea-4715-4ec0-abf1-723058744499 from snapshot 69918783-1944-485d-ab03-aebf67109cf6 {{(pid=82738) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-quobyte-ec5432ea-4715-4ec0-abf1-723058744499" by "_copy_volume_from_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-ec5432ea-4715-4ec0-abf1-723058744499" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] snapshot: 69918783-1944-485d-ab03-aebf67109cf6, volume: ec5432ea-4715-4ec0-abf1-723058744499, {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb34279-2466-46b3-bd0a-5c95de6c335f]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:35 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6 Feb 27 02:08:35 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-05200f21-b7d9-4958-bd7b-96353108bdde tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:35 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6" returned: 0 in 0.666s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Creating direct copy from snapshot {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b095dae-f655-4c9d-bcd9-956cfcf3ab03]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:36 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc Feb 27 02:08:36 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:36 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc" returned: 0 in 0.616s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:36 devstack cinder-volume[82738]: DEBUG cinder.utils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Path /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ec5432ea-4715-4ec0-abf1-723058744499 not found in is_blk_device check {{(pid=82738) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:08:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ec5432ea-4715-4ec0-abf1-723058744499 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:36 devstack sudo[88131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ec5432ea-4715-4ec0-abf1-723058744499 Feb 27 02:08:36 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:39 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ec5432ea-4715-4ec0-abf1-723058744499" returned: 0 in 2.781s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:39 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ae19f5-e240-4143-872f-8c261778d9cb]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:39 devstack sudo[88172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc Feb 27 02:08:39 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:40 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc" returned: 0 in 0.618s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc, size 1024.00 MB, duration 2.78 sec, destination /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ec5432ea-4715-4ec0-abf1-723058744499 {{(pid=82738) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:08:40 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Converted 1024.00 MB image at 368.04 MB/s Feb 27 02:08:40 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ec5432ea-4715-4ec0-abf1-723058744499 is being set with open permissions: ugo+rw Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ec5432ea-4715-4ec0-abf1-723058744499 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:40 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ec5432ea-4715-4ec0-abf1-723058744499 Feb 27 02:08:40 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:40 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ec5432ea-4715-4ec0-abf1-723058744499" returned: 0 in 0.471s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-ec5432ea-4715-4ec0-abf1-723058744499" released by "_copy_volume_from_snapshot" :: held 5.222s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-69918783-1944-485d-ab03-aebf67109cf6-ec5432ea-4715-4ec0-abf1-723058744499" released by "_create_volume_from_snapshot" :: held 5.249s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.260s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-05200f21-b7d9-4958-bd7b-96353108bdde tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.703s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-05200f21-b7d9-4958-bd7b-96353108bdde tempest-VolumeDependencyTests-1173424542 None] Creating offline snapshot f6ee9d78-4bd6-43a6-b21a-8920afebbd00 of volume 198498e9-ce13-44fe-ba3e-960b85720875 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef8fb2c5-bc6b-4af8-8ce3-bf0c96dffe2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec5432ea-4715-4ec0-abf1-723058744499', 'volume_size': 2, 'snapshot_id': '69918783-1944-485d-ab03-aebf67109cf6'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f36ad82-b456-46a9-9e44-0fdcc94ddad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fff885d-0b62-4af6-bb29-198712b75014]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-05200f21-b7d9-4958-bd7b-96353108bdde tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:40 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Volume volume-ec5432ea-4715-4ec0-abf1-723058744499 (ec5432ea-4715-4ec0-abf1-723058744499): created successfully Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f36ad82-b456-46a9-9e44-0fdcc94ddad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Flow 'volume_create_manager' (d9cd69de-f4c6-4b7b-ad9c-90df281b7a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:40 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-7e8c870a-e4fa-4865-9b04-1eddd91b1668 tempest-VolumesSnapshotTestJSON-503274425 None] Created volume successfully. Feb 27 02:08:40 devstack sudo[88181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 Feb 27 02:08:40 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-afabbd08-dd8f-43ba-8c2a-b235f781a306 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-ec5432ea-4715-4ec0-abf1-723058744499-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-afabbd08-dd8f-43ba-8c2a-b235f781a306 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-ec5432ea-4715-4ec0-abf1-723058744499-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-afabbd08-dd8f-43ba-8c2a-b235f781a306 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-quobyte-ec5432ea-4715-4ec0-abf1-723058744499" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-afabbd08-dd8f-43ba-8c2a-b235f781a306 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-ec5432ea-4715-4ec0-abf1-723058744499" acquired by "delete_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2d7445-d6b7-455a-8153-ee5f18ba5e86]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-afabbd08-dd8f-43ba-8c2a-b235f781a306 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ec5432ea-4715-4ec0-abf1-723058744499 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:40 devstack sudo[88183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ec5432ea-4715-4ec0-abf1-723058744499 Feb 27 02:08:40 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:41 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-05200f21-b7d9-4958-bd7b-96353108bdde tempest-VolumeDependencyTests-1173424542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875" returned: 0 in 0.681s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-05200f21-b7d9-4958-bd7b-96353108bdde tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:41 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00 1G Feb 27 02:08:41 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:41 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-afabbd08-dd8f-43ba-8c2a-b235f781a306 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ec5432ea-4715-4ec0-abf1-723058744499" returned: 0 in 0.593s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-afabbd08-dd8f-43ba-8c2a-b235f781a306 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ec5432ea-4715-4ec0-abf1-723058744499 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:41 devstack sudo[88193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ec5432ea-4715-4ec0-abf1-723058744499 Feb 27 02:08:41 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:41 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-05200f21-b7d9-4958-bd7b-96353108bdde tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00 1G" returned: 0 in 0.668s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-05200f21-b7d9-4958-bd7b-96353108bdde tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198498e9-ce13-44fe-ba3e-960b85720875 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:41 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-afabbd08-dd8f-43ba-8c2a-b235f781a306 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ec5432ea-4715-4ec0-abf1-723058744499" returned: 0 in 0.479s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:41 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198498e9-ce13-44fe-ba3e-960b85720875 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00 Feb 27 02:08:41 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:41 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-afabbd08-dd8f-43ba-8c2a-b235f781a306 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-ec5432ea-4715-4ec0-abf1-723058744499" released by "delete_volume" :: held 1.105s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:41 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-afabbd08-dd8f-43ba-8c2a-b235f781a306 tempest-VolumesSnapshotTestJSON-503274425 None] Created reservations ['89d691ee-ab36-43ac-a5cb-4ad2034990ad', 'c4533927-2ede-40fe-828e-24e853f0840f', '3074f08b-721c-428f-884b-9bc4738ca048', 'bb657568-f3c3-459b-b128-8502ec55479a'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-afabbd08-dd8f-43ba-8c2a-b235f781a306 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-afabbd08-dd8f-43ba-8c2a-b235f781a306 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:42 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-afabbd08-dd8f-43ba-8c2a-b235f781a306 tempest-VolumesSnapshotTestJSON-503274425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:42 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-afabbd08-dd8f-43ba-8c2a-b235f781a306 tempest-VolumesSnapshotTestJSON-503274425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-afabbd08-dd8f-43ba-8c2a-b235f781a306 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-afabbd08-dd8f-43ba-8c2a-b235f781a306 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:42 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:08:42 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:42 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-afabbd08-dd8f-43ba-8c2a-b235f781a306 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.525s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:42 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-afabbd08-dd8f-43ba-8c2a-b235f781a306 tempest-VolumesSnapshotTestJSON-503274425 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:42 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-afabbd08-dd8f-43ba-8c2a-b235f781a306 tempest-VolumesSnapshotTestJSON-503274425 None] Deleted volume successfully. Feb 27 02:08:42 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-afabbd08-dd8f-43ba-8c2a-b235f781a306 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-ec5432ea-4715-4ec0-abf1-723058744499-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:42 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-05200f21-b7d9-4958-bd7b-96353108bdde tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198498e9-ce13-44fe-ba3e-960b85720875 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00" returned: 0 in 0.796s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:42 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-05200f21-b7d9-4958-bd7b-96353108bdde tempest-VolumeDependencyTests-1173424542 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00 is being set with open permissions: ugo+rw Feb 27 02:08:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-05200f21-b7d9-4958-bd7b-96353108bdde tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:42 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00 Feb 27 02:08:42 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-69918783-1944-485d-ab03-aebf67109cf6-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-69918783-1944-485d-ab03-aebf67109cf6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-quobyte-d4e96bca-18e3-4f04-bcda-f072fddd2efc" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-d4e96bca-18e3-4f04-bcda-f072fddd2efc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-quobyte-69918783-1944-485d-ab03-aebf67109cf6" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-69918783-1944-485d-ab03-aebf67109cf6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:43 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] Deleting offline snapshot 69918783-1944-485d-ab03-aebf67109cf6 of volume d4e96bca-18e3-4f04-bcda-f072fddd2efc {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:08:43 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] snapshot_file for this snap is: volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:08:43 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[988c9359-f5fb-416f-b0fa-899cdda2311b]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:43 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6 Feb 27 02:08:43 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:43 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-05200f21-b7d9-4958-bd7b-96353108bdde tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00" returned: 0 in 0.721s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-05200f21-b7d9-4958-bd7b-96353108bdde tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:43 devstack sudo[88243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.info Feb 27 02:08:43 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:43 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6" returned: 0 in 0.594s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:43 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:43 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0cd327-a591-4d5b-9774-ec39af63e848]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:43 devstack sudo[88248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc Feb 27 02:08:43 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:44 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-05200f21-b7d9-4958-bd7b-96353108bdde tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.info" returned: 0 in 0.606s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:44 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-05200f21-b7d9-4958-bd7b-96353108bdde tempest-VolumeDependencyTests-1173424542 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.info is being set with open permissions: ugo+rw Feb 27 02:08:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-05200f21-b7d9-4958-bd7b-96353108bdde tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:44 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.info Feb 27 02:08:44 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:44 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-05200f21-b7d9-4958-bd7b-96353108bdde tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.info" returned: 0 in 0.688s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-05200f21-b7d9-4958-bd7b-96353108bdde tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.256s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:44 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-05200f21-b7d9-4958-bd7b-96353108bdde tempest-VolumeDependencyTests-1173424542 None] Create snapshot completed successfully Feb 27 02:08:44 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc" returned: 0 in 1.073s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:44 devstack sudo[88257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6 Feb 27 02:08:44 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Flow 'volume_create_manager' (6cbc9a48-df51-4a21-87ec-dcb51734dbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99bf9ba9-c46f-4a32-88d5-c7f946896367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99bf9ba9-c46f-4a32-88d5-c7f946896367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1340645455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c02da0-7f67-4af9-a264-faea1bcf734c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10423f8aa92d43b8abfabb3445cdb267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:45Z,use_quota=True,user_id='e23b064e2a5c4fd2a62060331be6cef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cec595c-cfa5-4290-b678-b33ccd864281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cec595c-cfa5-4290-b678-b33ccd864281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9a769c-2aed-419b-890c-70b0366a502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9a769c-2aed-419b-890c-70b0366a502d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9c02da0-7f67-4af9-a264-faea1bcf734c', 'volume_name': 'volume-d9c02da0-7f67-4af9-a264-faea1bcf734c', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e11c065f-5cb2-4362-af5a-e66561d50324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e11c065f-5cb2-4362-af5a-e66561d50324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458de86a-8717-4f88-b36f-56214cd211d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Volume d9c02da0-7f67-4af9-a264-faea1bcf734c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9c02da0-7f67-4af9-a264-faea1bcf734c', 'volume_size': 1} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1340645455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c02da0-7f67-4af9-a264-faea1bcf734c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10423f8aa92d43b8abfabb3445cdb267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:45Z,use_quota=True,user_id='e23b064e2a5c4fd2a62060331be6cef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Creating volume d9c02da0-7f67-4af9-a264-faea1bcf734c {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:45 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d9c02da0-7f67-4af9-a264-faea1bcf734c 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:45 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d9c02da0-7f67-4af9-a264-faea1bcf734c 1073741824 Feb 27 02:08:45 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Flow 'volume_create_manager' (f2b5f215-6c9c-48ed-9647-6a022c36c872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d7dd3b-a9d8-487b-a47f-d2c9c35a18d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d7dd3b-a9d8-487b-a47f-d2c9c35a18d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-532493414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f02afb4-dfcc-403a-b7f9-0f2931a4df44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072abd4304544ff6982304f57051dff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f6ee9d78-4bd6-43a6-b21a-8920afebbd00,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:46Z,use_quota=True,user_id='379da0d623584a429d6404c08b7a8d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7be851-691c-40c0-9003-25e4f3096ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7be851-691c-40c0-9003-25e4f3096ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f19da52-9ca7-4984-9796-eba1f3da541c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f19da52-9ca7-4984-9796-eba1f3da541c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9f02afb4-dfcc-403a-b7f9-0f2931a4df44', 'volume_name': 'volume-9f02afb4-dfcc-403a-b7f9-0f2931a4df44', 'volume_size': 1, 'snapshot_id': 'f6ee9d78-4bd6-43a6-b21a-8920afebbd00'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a42724-7379-4cd2-8769-06a6a4db35b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a42724-7379-4cd2-8769-06a6a4db35b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc3665d-955d-49b7-b6c8-43c42e093e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Volume 9f02afb4-dfcc-403a-b7f9-0f2931a4df44: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9f02afb4-dfcc-403a-b7f9-0f2931a4df44', 'volume_size': 1, 'snapshot_id': 'f6ee9d78-4bd6-43a6-b21a-8920afebbd00'} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:45 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6" returned: 0 in 0.960s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:45 devstack sudo[88264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6 Feb 27 02:08:45 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:46 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d9c02da0-7f67-4af9-a264-faea1bcf734c 1073741824" returned: 0 in 1.093s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d9c02da0-7f67-4af9-a264-faea1bcf734c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:46 devstack sudo[88269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d9c02da0-7f67-4af9-a264-faea1bcf734c Feb 27 02:08:46 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:46 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc.69918783-1944-485d-ab03-aebf67109cf6" returned: 0 in 0.617s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-69918783-1944-485d-ab03-aebf67109cf6" released by "_delete_snapshot" :: held 3.389s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-d4e96bca-18e3-4f04-bcda-f072fddd2efc" released by "delete_snapshot" :: held 3.413s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] Created reservations ['af953ca4-e2de-44cf-afb1-2f7ef76d5a21', '0774b710-1d5e-40da-a3de-740185198389', 'ca4e5d42-307b-4f0e-82ef-3ab53f90cb31', '830b81bb-2bcf-40cf-93c1-8cfa6fa21a16'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:46 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] Delete snapshot completed successfully. Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-096c5d9c-7484-4e60-b96c-b3615543b19a tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-69918783-1944-485d-ab03-aebf67109cf6-delete_snapshot" released by "delete_snapshot" :: held 3.622s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:46 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d9c02da0-7f67-4af9-a264-faea1bcf734c" returned: 0 in 0.566s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.056s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "cinder-quobyte-f6ee9d78-4bd6-43a6-b21a-8920afebbd00-9f02afb4-dfcc-403a-b7f9-0f2931a4df44" by "_create_volume_from_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458de86a-8717-4f88-b36f-56214cd211d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9c02da0-7f67-4af9-a264-faea1bcf734c', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7bdd8f3-6025-4b74-8b3d-5f4605631fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-quobyte-f6ee9d78-4bd6-43a6-b21a-8920afebbd00-9f02afb4-dfcc-403a-b7f9-0f2931a4df44" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Creating volume 9f02afb4-dfcc-403a-b7f9-0f2931a4df44 from snapshot f6ee9d78-4bd6-43a6-b21a-8920afebbd00 {{(pid=82738) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "cinder-quobyte-9f02afb4-dfcc-403a-b7f9-0f2931a4df44" by "_copy_volume_from_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:46 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Volume volume-d9c02da0-7f67-4af9-a264-faea1bcf734c (d9c02da0-7f67-4af9-a264-faea1bcf734c): created successfully Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7bdd8f3-6025-4b74-8b3d-5f4605631fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Flow 'volume_create_manager' (6cbc9a48-df51-4a21-87ec-dcb51734dbec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-quobyte-9f02afb4-dfcc-403a-b7f9-0f2931a4df44" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] snapshot: f6ee9d78-4bd6-43a6-b21a-8920afebbd00, volume: 9f02afb4-dfcc-403a-b7f9-0f2931a4df44, {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:08:46 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-57fbecee-1784-4156-9e6c-8a0ce8bf065a tempest-ServerRescueNegativeTestJSON-1608445096 None] Created volume successfully. Feb 27 02:08:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:47 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[1655f44c-d701-46cd-a928-39b80173bd76]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:47 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00 Feb 27 02:08:47 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b3bbf51e-0583-4806-a46b-020f0d8e64ed tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-d4e96bca-18e3-4f04-bcda-f072fddd2efc-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b3bbf51e-0583-4806-a46b-020f0d8e64ed tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-d4e96bca-18e3-4f04-bcda-f072fddd2efc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b3bbf51e-0583-4806-a46b-020f0d8e64ed tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-quobyte-d4e96bca-18e3-4f04-bcda-f072fddd2efc" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b3bbf51e-0583-4806-a46b-020f0d8e64ed tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-d4e96bca-18e3-4f04-bcda-f072fddd2efc" acquired by "delete_volume" :: waited 0.031s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:47 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddb5818-1b47-43ba-8842-e3640e479469]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b3bbf51e-0583-4806-a46b-020f0d8e64ed tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:47 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00" returned: 0 in 0.884s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198498e9-ce13-44fe-ba3e-960b85720875(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:08:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Creating direct copy from snapshot {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:08:47 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[87464c99-7a4c-46df-b64a-6052f4b04ca3]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:47 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc Feb 27 02:08:47 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:48 devstack sudo[88279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 Feb 27 02:08:48 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:48 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b3bbf51e-0583-4806-a46b-020f0d8e64ed tempest-VolumesSnapshotTestJSON-503274425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc" returned: 0 in 0.801s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b3bbf51e-0583-4806-a46b-020f0d8e64ed tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:48 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc Feb 27 02:08:48 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:48 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875" returned: 0 in 0.911s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:48 devstack cinder-volume[82738]: DEBUG cinder.utils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Path /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9f02afb4-dfcc-403a-b7f9-0f2931a4df44 not found in is_blk_device check {{(pid=82738) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:08:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9f02afb4-dfcc-403a-b7f9-0f2931a4df44 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:48 devstack sudo[88290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9f02afb4-dfcc-403a-b7f9-0f2931a4df44 Feb 27 02:08:48 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:49 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b3bbf51e-0583-4806-a46b-020f0d8e64ed tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d4e96bca-18e3-4f04-bcda-f072fddd2efc" returned: 0 in 0.799s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b3bbf51e-0583-4806-a46b-020f0d8e64ed tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-d4e96bca-18e3-4f04-bcda-f072fddd2efc" released by "delete_volume" :: held 1.680s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:49 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-b3bbf51e-0583-4806-a46b-020f0d8e64ed tempest-VolumesSnapshotTestJSON-503274425 None] Created reservations ['793ebc8e-3b88-482b-ae9a-fa44f945e0c7', '3dfd6915-8f45-4b8e-9d41-4e316ee182ec', '650a8968-3b81-4c46-bd58-a517d726bf31', '58d24ac2-63bf-4214-94c7-03681a2f169f'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b3bbf51e-0583-4806-a46b-020f0d8e64ed tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b3bbf51e-0583-4806-a46b-020f0d8e64ed tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:49 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b3bbf51e-0583-4806-a46b-020f0d8e64ed tempest-VolumesSnapshotTestJSON-503274425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:49 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b3bbf51e-0583-4806-a46b-020f0d8e64ed tempest-VolumesSnapshotTestJSON-503274425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b3bbf51e-0583-4806-a46b-020f0d8e64ed tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b3bbf51e-0583-4806-a46b-020f0d8e64ed tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:49 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:08:49 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:51 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Flow 'volume_create_manager' (37627e20-1fb1-4b8f-9df0-c51be74fa8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd2b8f8-261d-491f-8678-c045bcf1e930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd2b8f8-261d-491f-8678-c045bcf1e930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-448685129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa54fff0-90c1-4786-a242-84012a59875a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31f4bf02da240efb07692eb11920ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:51Z,use_quota=True,user_id='144de0574cb04775b842d47dead21501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebea394d-255a-4476-ab74-a53b3624b56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebea394d-255a-4476-ab74-a53b3624b56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f59da43-b199-4c9b-9690-051158c8d19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f59da43-b199-4c9b-9690-051158c8d19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa54fff0-90c1-4786-a242-84012a59875a', 'volume_name': 'volume-fa54fff0-90c1-4786-a242-84012a59875a', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:51 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6aaea6-3e5e-4fdb-93f3-3253d2a98e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6aaea6-3e5e-4fdb-93f3-3253d2a98e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b9fa787-a8a0-4f60-8845-be44d0583508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:52 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Volume fa54fff0-90c1-4786-a242-84012a59875a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa54fff0-90c1-4786-a242-84012a59875a', 'volume_size': 1} Feb 27 02:08:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:52 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b3bbf51e-0583-4806-a46b-020f0d8e64ed tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 2.803s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:52 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-b3bbf51e-0583-4806-a46b-020f0d8e64ed tempest-VolumesSnapshotTestJSON-503274425 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:52 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-b3bbf51e-0583-4806-a46b-020f0d8e64ed tempest-VolumesSnapshotTestJSON-503274425 None] Deleted volume successfully. Feb 27 02:08:52 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b3bbf51e-0583-4806-a46b-020f0d8e64ed tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-d4e96bca-18e3-4f04-bcda-f072fddd2efc-delete_volume" released by "delete_volume" :: held 4.850s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:52 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9f02afb4-dfcc-403a-b7f9-0f2931a4df44" returned: 0 in 3.983s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:52 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[e601607f-2a6c-4e2b-84d0-af8743101744]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:52 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 Feb 27 02:08:52 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:53 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875" returned: 0 in 0.753s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:53 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875, size 1024.00 MB, duration 3.99 sec, destination /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9f02afb4-dfcc-403a-b7f9-0f2931a4df44 {{(pid=82738) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:08:53 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Converted 1024.00 MB image at 256.95 MB/s Feb 27 02:08:53 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9f02afb4-dfcc-403a-b7f9-0f2931a4df44 is being set with open permissions: ugo+rw Feb 27 02:08:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9f02afb4-dfcc-403a-b7f9-0f2931a4df44 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:53 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9f02afb4-dfcc-403a-b7f9-0f2931a4df44 Feb 27 02:08:53 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:54 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9f02afb4-dfcc-403a-b7f9-0f2931a4df44" returned: 0 in 0.500s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-quobyte-9f02afb4-dfcc-403a-b7f9-0f2931a4df44" released by "_copy_volume_from_snapshot" :: held 7.125s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-quobyte-f6ee9d78-4bd6-43a6-b21a-8920afebbd00-9f02afb4-dfcc-403a-b7f9-0f2931a4df44" released by "_create_volume_from_snapshot" :: held 7.164s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.189s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.095s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-448685129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa54fff0-90c1-4786-a242-84012a59875a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31f4bf02da240efb07692eb11920ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:51Z,use_quota=True,user_id='144de0574cb04775b842d47dead21501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Creating volume fa54fff0-90c1-4786-a242-84012a59875a {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:54 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:54 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a 1073741824 Feb 27 02:08:54 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc3665d-955d-49b7-b6c8-43c42e093e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f02afb4-dfcc-403a-b7f9-0f2931a4df44', 'volume_size': 1, 'snapshot_id': 'f6ee9d78-4bd6-43a6-b21a-8920afebbd00'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84fe48eb-0dc0-4515-a736-fd99341a3d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=137,cinder:INSERT=47,cinder:UPDATE=168,cinder:DELETE=9 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:08:54 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Volume volume-9f02afb4-dfcc-403a-b7f9-0f2931a4df44 (9f02afb4-dfcc-403a-b7f9-0f2931a4df44): created successfully Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84fe48eb-0dc0-4515-a736-fd99341a3d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Flow 'volume_create_manager' (f2b5f215-6c9c-48ed-9647-6a022c36c872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:54 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-148444a9-3d00-48dc-a162-ab11cdeb27fb tempest-VolumeDependencyTests-1173424542 None] Created volume successfully. Feb 27 02:08:54 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a 1073741824" returned: 0 in 0.564s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:54 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a Feb 27 02:08:54 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "cinder-f6ee9d78-4bd6-43a6-b21a-8920afebbd00-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-f6ee9d78-4bd6-43a6-b21a-8920afebbd00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "cinder-quobyte-198498e9-ce13-44fe-ba3e-960b85720875" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-quobyte-198498e9-ce13-44fe-ba3e-960b85720875" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "cinder-quobyte-f6ee9d78-4bd6-43a6-b21a-8920afebbd00" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-quobyte-f6ee9d78-4bd6-43a6-b21a-8920afebbd00" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] Deleting offline snapshot f6ee9d78-4bd6-43a6-b21a-8920afebbd00 of volume 198498e9-ce13-44fe-ba3e-960b85720875 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] snapshot_file for this snap is: volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6d8d1f-c91a-4757-ad64-7ac5236915c5]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:55 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00 Feb 27 02:08:55 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:55 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a" returned: 0 in 0.470s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:55 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b9fa787-a8a0-4f60-8845-be44d0583508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa54fff0-90c1-4786-a242-84012a59875a', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39598abf-628d-48d6-9a46-c29c79127cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:55 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Volume volume-fa54fff0-90c1-4786-a242-84012a59875a (fa54fff0-90c1-4786-a242-84012a59875a): created successfully Feb 27 02:08:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39598abf-628d-48d6-9a46-c29c79127cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Flow 'volume_create_manager' (37627e20-1fb1-4b8f-9df0-c51be74fa8a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:55 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-19523516-1514-482c-80b8-b20669e41ca4 tempest-VolumesSnapshotTestJSON-503274425 None] Created volume successfully. Feb 27 02:08:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-321f8c62-aafe-40ef-a648-a2e1909539c1 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-321f8c62-aafe-40ef-a648-a2e1909539c1 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:55 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-321f8c62-aafe-40ef-a648-a2e1909539c1 tempest-VolumesSnapshotTestJSON-503274425 None] Creating offline snapshot d3379165-46d5-4a69-b6ae-c8f1de8009ba of volume fa54fff0-90c1-4786-a242-84012a59875a {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:55 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00" returned: 0 in 0.669s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:55 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198498e9-ce13-44fe-ba3e-960b85720875(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:55 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdf8411-46e9-4c7f-88f9-9297d8b9b8fd]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-321f8c62-aafe-40ef-a648-a2e1909539c1 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:55 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0798f6-71cf-448f-b9b1-e64413e466f5]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:55 devstack sudo[88359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 Feb 27 02:08:55 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:55 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a Feb 27 02:08:55 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:56 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875" returned: 0 in 0.589s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:56 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-321f8c62-aafe-40ef-a648-a2e1909539c1 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a" returned: 0 in 0.625s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-321f8c62-aafe-40ef-a648-a2e1909539c1 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:56 devstack sudo[88368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00 Feb 27 02:08:56 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:56 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba 1G Feb 27 02:08:56 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:57 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-321f8c62-aafe-40ef-a648-a2e1909539c1 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba 1G" returned: 0 in 0.917s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-321f8c62-aafe-40ef-a648-a2e1909539c1 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa54fff0-90c1-4786-a242-84012a59875a -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:57 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00" returned: 0 in 0.971s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:57 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa54fff0-90c1-4786-a242-84012a59875a -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba Feb 27 02:08:57 devstack sudo[88407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00 Feb 27 02:08:57 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:57 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:57 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875.f6ee9d78-4bd6-43a6-b21a-8920afebbd00" returned: 0 in 0.655s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:57 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-quobyte-f6ee9d78-4bd6-43a6-b21a-8920afebbd00" released by "_delete_snapshot" :: held 3.056s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:57 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-quobyte-198498e9-ce13-44fe-ba3e-960b85720875" released by "delete_snapshot" :: held 3.076s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:58 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] Created reservations ['4d36ae79-9744-4d82-a94e-10a46bcefad0', '131e65a0-3301-4c56-8211-76ce8a99e7fd', '101f30ad-dbb1-4d1a-8311-b4aa839364cc', '3c878d5d-d091-4c48-bf2b-71c2d8a5da22'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:58 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] Delete snapshot completed successfully. Feb 27 02:08:58 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1678f703-f992-41af-8656-ec2fec7baac7 tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-f6ee9d78-4bd6-43a6-b21a-8920afebbd00-delete_snapshot" released by "delete_snapshot" :: held 3.229s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:58 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-321f8c62-aafe-40ef-a648-a2e1909539c1 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa54fff0-90c1-4786-a242-84012a59875a -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba" returned: 0 in 1.047s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:58 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-321f8c62-aafe-40ef-a648-a2e1909539c1 tempest-VolumesSnapshotTestJSON-503274425 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba is being set with open permissions: ugo+rw Feb 27 02:08:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-321f8c62-aafe-40ef-a648-a2e1909539c1 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:58 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba Feb 27 02:08:58 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:58 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-321f8c62-aafe-40ef-a648-a2e1909539c1 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba" returned: 0 in 0.473s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-321f8c62-aafe-40ef-a648-a2e1909539c1 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:58 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.info Feb 27 02:08:58 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:59 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8cd705c5-d872-4af4-a6d3-ec22c2e27f3d tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "cinder-198498e9-ce13-44fe-ba3e-960b85720875-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:59 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8cd705c5-d872-4af4-a6d3-ec22c2e27f3d tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-198498e9-ce13-44fe-ba3e-960b85720875-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:59 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8cd705c5-d872-4af4-a6d3-ec22c2e27f3d tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "cinder-quobyte-198498e9-ce13-44fe-ba3e-960b85720875" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:59 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8cd705c5-d872-4af4-a6d3-ec22c2e27f3d tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-quobyte-198498e9-ce13-44fe-ba3e-960b85720875" acquired by "delete_volume" :: waited 0.024s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:59 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-321f8c62-aafe-40ef-a648-a2e1909539c1 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.info" returned: 0 in 0.676s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:59 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-321f8c62-aafe-40ef-a648-a2e1909539c1 tempest-VolumesSnapshotTestJSON-503274425 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.info is being set with open permissions: ugo+rw Feb 27 02:08:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-321f8c62-aafe-40ef-a648-a2e1909539c1 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:59 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.info Feb 27 02:08:59 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:59 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e0ac4e-7282-4d48-aa41-48e424105d6c]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8cd705c5-d872-4af4-a6d3-ec22c2e27f3d tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:59 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 Feb 27 02:08:59 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:00 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-321f8c62-aafe-40ef-a648-a2e1909539c1 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.info" returned: 0 in 0.758s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-321f8c62-aafe-40ef-a648-a2e1909539c1 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.603s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:00 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-321f8c62-aafe-40ef-a648-a2e1909539c1 tempest-VolumesSnapshotTestJSON-503274425 None] Create snapshot completed successfully Feb 27 02:09:00 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8cd705c5-d872-4af4-a6d3-ec22c2e27f3d tempest-VolumeDependencyTests-1173424542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875" returned: 0 in 1.018s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8cd705c5-d872-4af4-a6d3-ec22c2e27f3d tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:00 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875 Feb 27 02:09:00 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:01 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8cd705c5-d872-4af4-a6d3-ec22c2e27f3d tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-198498e9-ce13-44fe-ba3e-960b85720875" returned: 0 in 0.993s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8cd705c5-d872-4af4-a6d3-ec22c2e27f3d tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-quobyte-198498e9-ce13-44fe-ba3e-960b85720875" released by "delete_volume" :: held 2.192s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Flow 'volume_create_manager' (13215803-d082-4a42-b47e-54a8e7200c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13911337-ef76-475a-a499-1a3711501699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13911337-ef76-475a-a499-1a3711501699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1663819285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae69f693-a6a3-45f4-b113-f2c2f2433e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31f4bf02da240efb07692eb11920ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d3379165-46d5-4a69-b6ae-c8f1de8009ba,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:01Z,use_quota=True,user_id='144de0574cb04775b842d47dead21501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42fa5bf9-5cb0-41c0-a481-9011aac1c735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42fa5bf9-5cb0-41c0-a481-9011aac1c735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df251a6-0d9a-4005-9ad2-35ca82d52500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df251a6-0d9a-4005-9ad2-35ca82d52500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ae69f693-a6a3-45f4-b113-f2c2f2433e2b', 'volume_name': 'volume-ae69f693-a6a3-45f4-b113-f2c2f2433e2b', 'volume_size': 1, 'snapshot_id': 'd3379165-46d5-4a69-b6ae-c8f1de8009ba'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd7176f6-2017-48dc-9d1d-626509c1adba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd7176f6-2017-48dc-9d1d-626509c1adba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbc38e5-360b-4b39-a543-d538e4e47074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:01 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Volume ae69f693-a6a3-45f4-b113-f2c2f2433e2b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ae69f693-a6a3-45f4-b113-f2c2f2433e2b', 'volume_size': 1, 'snapshot_id': 'd3379165-46d5-4a69-b6ae-c8f1de8009ba'} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-quobyte-d3379165-46d5-4a69-b6ae-c8f1de8009ba-ae69f693-a6a3-45f4-b113-f2c2f2433e2b" by "_create_volume_from_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-8cd705c5-d872-4af4-a6d3-ec22c2e27f3d tempest-VolumeDependencyTests-1173424542 None] Created reservations ['f3e279cd-3da6-4170-a4a5-740a4fb7ca74', '5d8b17ec-f76d-4fd0-a841-22073b5ee562', '723a3689-7579-46da-985c-700913cb84e9', '43dbc64b-f614-464a-a42a-b2305e33b336'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-d3379165-46d5-4a69-b6ae-c8f1de8009ba-ae69f693-a6a3-45f4-b113-f2c2f2433e2b" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Creating volume ae69f693-a6a3-45f4-b113-f2c2f2433e2b from snapshot d3379165-46d5-4a69-b6ae-c8f1de8009ba {{(pid=82738) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-quobyte-ae69f693-a6a3-45f4-b113-f2c2f2433e2b" by "_copy_volume_from_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-ae69f693-a6a3-45f4-b113-f2c2f2433e2b" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] snapshot: d3379165-46d5-4a69-b6ae-c8f1de8009ba, volume: ae69f693-a6a3-45f4-b113-f2c2f2433e2b, {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ebec67-0c18-4f70-92ef-6f5bf614fb4e]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8cd705c5-d872-4af4-a6d3-ec22c2e27f3d tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8cd705c5-d872-4af4-a6d3-ec22c2e27f3d tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8cd705c5-d872-4af4-a6d3-ec22c2e27f3d tempest-VolumeDependencyTests-1173424542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8cd705c5-d872-4af4-a6d3-ec22c2e27f3d tempest-VolumeDependencyTests-1173424542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8cd705c5-d872-4af4-a6d3-ec22c2e27f3d tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8cd705c5-d872-4af4-a6d3-ec22c2e27f3d tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:01 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:09:01 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:01 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba Feb 27 02:09:01 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:02 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba" returned: 0 in 1.144s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa54fff0-90c1-4786-a242-84012a59875a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:09:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Creating direct copy from snapshot {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:09:02 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe163ee7-b070-4d89-9fe9-4d3349a48fd8]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:02 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8cd705c5-d872-4af4-a6d3-ec22c2e27f3d tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 1.073s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:03 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-8cd705c5-d872-4af4-a6d3-ec22c2e27f3d tempest-VolumeDependencyTests-1173424542 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:03 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-8cd705c5-d872-4af4-a6d3-ec22c2e27f3d tempest-VolumeDependencyTests-1173424542 None] Deleted volume successfully. Feb 27 02:09:03 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8cd705c5-d872-4af4-a6d3-ec22c2e27f3d tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-198498e9-ce13-44fe-ba3e-960b85720875-delete_volume" released by "delete_volume" :: held 3.902s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:03 devstack sudo[88491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a Feb 27 02:09:03 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:03 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:UPDATE=145,cinder:DELETE=17,cinder:SELECT=115,cinder:INSERT=30 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:09:03 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Flow 'volume_create_manager' (edf0a0ce-9e1d-4c65-9aac-7cfa33f9d56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306a6e14-ca57-4a5e-b2f0-a3df3a813e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306a6e14-ca57-4a5e-b2f0-a3df3a813e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1478047182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad258b1e-f525-428b-9413-b41eba3b4ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072abd4304544ff6982304f57051dff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:03Z,use_quota=True,user_id='379da0d623584a429d6404c08b7a8d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717ba8ea-695a-4695-ac7f-12c242f96a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717ba8ea-695a-4695-ac7f-12c242f96a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e21306-32b0-4fa1-b052-9a42d511e05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e21306-32b0-4fa1-b052-9a42d511e05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad258b1e-f525-428b-9413-b41eba3b4ae4', 'volume_name': 'volume-ad258b1e-f525-428b-9413-b41eba3b4ae4', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0050b90-d4c6-4642-b8c3-5abe40acf812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0050b90-d4c6-4642-b8c3-5abe40acf812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fd3604-9fa5-42d6-b2f7-7f395feab312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:03 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Volume ad258b1e-f525-428b-9413-b41eba3b4ae4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad258b1e-f525-428b-9413-b41eba3b4ae4', 'volume_size': 1} Feb 27 02:09:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:03 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a" returned: 0 in 0.797s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:03 devstack cinder-volume[82738]: DEBUG cinder.utils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Path /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ae69f693-a6a3-45f4-b113-f2c2f2433e2b not found in is_blk_device check {{(pid=82738) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:09:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ae69f693-a6a3-45f4-b113-f2c2f2433e2b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:03 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ae69f693-a6a3-45f4-b113-f2c2f2433e2b Feb 27 02:09:03 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-aee82693-af97-4587-9904-753fbb339fa8 tempest-ServerRescueNegativeTestJSON-1608445096 None] Acquiring lock "cinder-d9c02da0-7f67-4af9-a264-faea1bcf734c-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-aee82693-af97-4587-9904-753fbb339fa8 tempest-ServerRescueNegativeTestJSON-1608445096 None] Lock "cinder-d9c02da0-7f67-4af9-a264-faea1bcf734c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-aee82693-af97-4587-9904-753fbb339fa8 tempest-ServerRescueNegativeTestJSON-1608445096 None] Acquiring lock "cinder-quobyte-d9c02da0-7f67-4af9-a264-faea1bcf734c" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-aee82693-af97-4587-9904-753fbb339fa8 tempest-ServerRescueNegativeTestJSON-1608445096 None] Lock "cinder-quobyte-d9c02da0-7f67-4af9-a264-faea1bcf734c" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:04 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b9821c-8299-4aaf-ba4f-7aaaf2bcbc3c]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-aee82693-af97-4587-9904-753fbb339fa8 tempest-ServerRescueNegativeTestJSON-1608445096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d9c02da0-7f67-4af9-a264-faea1bcf734c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:04 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d9c02da0-7f67-4af9-a264-faea1bcf734c Feb 27 02:09:04 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:05 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-aee82693-af97-4587-9904-753fbb339fa8 tempest-ServerRescueNegativeTestJSON-1608445096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d9c02da0-7f67-4af9-a264-faea1bcf734c" returned: 0 in 1.211s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-aee82693-af97-4587-9904-753fbb339fa8 tempest-ServerRescueNegativeTestJSON-1608445096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d9c02da0-7f67-4af9-a264-faea1bcf734c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:05 devstack sudo[88513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d9c02da0-7f67-4af9-a264-faea1bcf734c Feb 27 02:09:05 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:07 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ae69f693-a6a3-45f4-b113-f2c2f2433e2b" returned: 0 in 4.071s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:07 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf847e51-4233-4301-aa93-f79af42eb260]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:07 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-aee82693-af97-4587-9904-753fbb339fa8 tempest-ServerRescueNegativeTestJSON-1608445096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d9c02da0-7f67-4af9-a264-faea1bcf734c" returned: 0 in 2.391s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:07 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-aee82693-af97-4587-9904-753fbb339fa8 tempest-ServerRescueNegativeTestJSON-1608445096 None] Lock "cinder-quobyte-d9c02da0-7f67-4af9-a264-faea1bcf734c" released by "delete_volume" :: held 3.670s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:07 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a Feb 27 02:09:07 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:07 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-aee82693-af97-4587-9904-753fbb339fa8 tempest-ServerRescueNegativeTestJSON-1608445096 None] Created reservations ['d115553b-6ae5-4180-84e5-89b2ff9dcc37', '68ea7d9e-5c32-437e-8429-1141b5981c50', '018a7eac-2238-4670-9f1f-78f71fbdf92a', '5ce64d43-9905-42d6-9502-c5ef6aeecefb'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-aee82693-af97-4587-9904-753fbb339fa8 tempest-ServerRescueNegativeTestJSON-1608445096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-aee82693-af97-4587-9904-753fbb339fa8 tempest-ServerRescueNegativeTestJSON-1608445096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-aee82693-af97-4587-9904-753fbb339fa8 tempest-ServerRescueNegativeTestJSON-1608445096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-aee82693-af97-4587-9904-753fbb339fa8 tempest-ServerRescueNegativeTestJSON-1608445096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-aee82693-af97-4587-9904-753fbb339fa8 tempest-ServerRescueNegativeTestJSON-1608445096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-aee82693-af97-4587-9904-753fbb339fa8 tempest-ServerRescueNegativeTestJSON-1608445096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:08 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:09:08 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:08 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-aee82693-af97-4587-9904-753fbb339fa8 tempest-ServerRescueNegativeTestJSON-1608445096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.831s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:08 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-aee82693-af97-4587-9904-753fbb339fa8 tempest-ServerRescueNegativeTestJSON-1608445096 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:08 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-aee82693-af97-4587-9904-753fbb339fa8 tempest-ServerRescueNegativeTestJSON-1608445096 None] Deleted volume successfully. Feb 27 02:09:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-aee82693-af97-4587-9904-753fbb339fa8 tempest-ServerRescueNegativeTestJSON-1608445096 None] Lock "cinder-d9c02da0-7f67-4af9-a264-faea1bcf734c-delete_volume" released by "delete_volume" :: held 4.709s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:08 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a" returned: 0 in 1.094s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:08 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a, size 1024.00 MB, duration 4.07 sec, destination /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ae69f693-a6a3-45f4-b113-f2c2f2433e2b {{(pid=82738) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:09:08 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Converted 1024.00 MB image at 251.45 MB/s Feb 27 02:09:08 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ae69f693-a6a3-45f4-b113-f2c2f2433e2b is being set with open permissions: ugo+rw Feb 27 02:09:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ae69f693-a6a3-45f4-b113-f2c2f2433e2b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:08 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ae69f693-a6a3-45f4-b113-f2c2f2433e2b Feb 27 02:09:08 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:09 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ae69f693-a6a3-45f4-b113-f2c2f2433e2b" returned: 0 in 0.525s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:09 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-ae69f693-a6a3-45f4-b113-f2c2f2433e2b" released by "_copy_volume_from_snapshot" :: held 7.758s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:09 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-d3379165-46d5-4a69-b6ae-c8f1de8009ba-ae69f693-a6a3-45f4-b113-f2c2f2433e2b" released by "_create_volume_from_snapshot" :: held 7.788s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.804s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.158s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1478047182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad258b1e-f525-428b-9413-b41eba3b4ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072abd4304544ff6982304f57051dff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:03Z,use_quota=True,user_id='379da0d623584a429d6404c08b7a8d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Creating volume ad258b1e-f525-428b-9413-b41eba3b4ae4 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:09 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:09:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbc38e5-360b-4b39-a543-d538e4e47074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae69f693-a6a3-45f4-b113-f2c2f2433e2b', 'volume_size': 1, 'snapshot_id': 'd3379165-46d5-4a69-b6ae-c8f1de8009ba'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d162d17c-120a-479c-bd16-2811006308c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:09 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 1073741824 Feb 27 02:09:09 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:09 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Volume volume-ae69f693-a6a3-45f4-b113-f2c2f2433e2b (ae69f693-a6a3-45f4-b113-f2c2f2433e2b): created successfully Feb 27 02:09:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d162d17c-120a-479c-bd16-2811006308c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Flow 'volume_create_manager' (13215803-d082-4a42-b47e-54a8e7200c60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:09 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-47e4b747-ffce-40a8-8daf-7172194b1da1 tempest-VolumesSnapshotTestJSON-503274425 None] Created volume successfully. Feb 27 02:09:09 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a9f0d218-f12f-43d6-99dd-0f9abb0d30e7 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-ae69f693-a6a3-45f4-b113-f2c2f2433e2b-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:10 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a9f0d218-f12f-43d6-99dd-0f9abb0d30e7 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-ae69f693-a6a3-45f4-b113-f2c2f2433e2b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:10 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a9f0d218-f12f-43d6-99dd-0f9abb0d30e7 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-quobyte-ae69f693-a6a3-45f4-b113-f2c2f2433e2b" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:10 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a9f0d218-f12f-43d6-99dd-0f9abb0d30e7 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-ae69f693-a6a3-45f4-b113-f2c2f2433e2b" acquired by "delete_volume" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:10 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31ffaa5-3cc1-4530-8404-fa97eedfd6ba]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a9f0d218-f12f-43d6-99dd-0f9abb0d30e7 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ae69f693-a6a3-45f4-b113-f2c2f2433e2b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:10 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ae69f693-a6a3-45f4-b113-f2c2f2433e2b Feb 27 02:09:10 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:10 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 1073741824" returned: 0 in 0.801s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:10 devstack sudo[88562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 Feb 27 02:09:10 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:10 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a9f0d218-f12f-43d6-99dd-0f9abb0d30e7 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ae69f693-a6a3-45f4-b113-f2c2f2433e2b" returned: 0 in 0.643s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a9f0d218-f12f-43d6-99dd-0f9abb0d30e7 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ae69f693-a6a3-45f4-b113-f2c2f2433e2b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:10 devstack sudo[88569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ae69f693-a6a3-45f4-b113-f2c2f2433e2b Feb 27 02:09:10 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:10 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4" returned: 0 in 0.538s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fd3604-9fa5-42d6-b2f7-7f395feab312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad258b1e-f525-428b-9413-b41eba3b4ae4', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a3ee3b-cf0a-415f-a144-490fec0cf35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:10 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Volume volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 (ad258b1e-f525-428b-9413-b41eba3b4ae4): created successfully Feb 27 02:09:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a3ee3b-cf0a-415f-a144-490fec0cf35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Flow 'volume_create_manager' (edf0a0ce-9e1d-4c65-9aac-7cfa33f9d56d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:10 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-80d6bdaa-cdaa-4932-bd7f-b724defd4b14 tempest-VolumeDependencyTests-1173424542 None] Created volume successfully. Feb 27 02:09:11 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a9f0d218-f12f-43d6-99dd-0f9abb0d30e7 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ae69f693-a6a3-45f4-b113-f2c2f2433e2b" returned: 0 in 0.578s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a9f0d218-f12f-43d6-99dd-0f9abb0d30e7 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-ae69f693-a6a3-45f4-b113-f2c2f2433e2b" released by "delete_volume" :: held 1.278s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-a9f0d218-f12f-43d6-99dd-0f9abb0d30e7 tempest-VolumesSnapshotTestJSON-503274425 None] Created reservations ['a0ff640c-0de6-421f-a702-ca32d3b2884d', 'ecee56e8-b584-4d03-8e23-495a1a3a5d01', 'bd8b6b5d-1cb5-493a-b8d7-c177a170f2d5', '3ddabbd2-d13d-4fae-848c-f842fe33013a'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a9f0d218-f12f-43d6-99dd-0f9abb0d30e7 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a9f0d218-f12f-43d6-99dd-0f9abb0d30e7 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-a9f0d218-f12f-43d6-99dd-0f9abb0d30e7 tempest-VolumesSnapshotTestJSON-503274425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-a9f0d218-f12f-43d6-99dd-0f9abb0d30e7 tempest-VolumesSnapshotTestJSON-503274425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a9f0d218-f12f-43d6-99dd-0f9abb0d30e7 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a9f0d218-f12f-43d6-99dd-0f9abb0d30e7 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:11 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:09:11 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Flow 'volume_create_manager' (288fd2d7-7a9f-4cf7-be51-c73c9777c3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30869f36-6eb1-4f69-aed4-b1307e0f05ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30869f36-6eb1-4f69-aed4-b1307e0f05ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1776848824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58dd0abb-3e09-4ef0-acd7-04a8ab73442c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072abd4304544ff6982304f57051dff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ad258b1e-f525-428b-9413-b41eba3b4ae4,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:12Z,use_quota=True,user_id='379da0d623584a429d6404c08b7a8d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb619f1-1b30-4588-918d-da9205ef7442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb619f1-1b30-4588-918d-da9205ef7442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18271bc-9e6d-4c6c-b059-22a2d65f4cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18271bc-9e6d-4c6c-b059-22a2d65f4cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '58dd0abb-3e09-4ef0-acd7-04a8ab73442c', 'volume_name': 'volume-58dd0abb-3e09-4ef0-acd7-04a8ab73442c', 'volume_size': 1, 'source_volid': 'ad258b1e-f525-428b-9413-b41eba3b4ae4', 'source_volstatus': 'available'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5adc10c3-b44c-4276-8f66-df14dca9e6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5adc10c3-b44c-4276-8f66-df14dca9e6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb19b503-ab87-4349-8f30-8eeddb464f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:11 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Volume 58dd0abb-3e09-4ef0-acd7-04a8ab73442c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-58dd0abb-3e09-4ef0-acd7-04a8ab73442c', 'volume_size': 1, 'source_volid': 'ad258b1e-f525-428b-9413-b41eba3b4ae4', 'source_volstatus': 'available'} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:11 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Cloning volume ad258b1e-f525-428b-9413-b41eba3b4ae4 to volume 58dd0abb-3e09-4ef0-acd7-04a8ab73442c Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Creating offline snapshot f1964a28-b43f-40c0-b60e-845713e41a78 of volume ad258b1e-f525-428b-9413-b41eba3b4ae4 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[071d74be-8b5a-4397-9e7b-f444056c6545]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:11 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 Feb 27 02:09:11 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:12 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a9f0d218-f12f-43d6-99dd-0f9abb0d30e7 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.608s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:12 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-a9f0d218-f12f-43d6-99dd-0f9abb0d30e7 tempest-VolumesSnapshotTestJSON-503274425 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:12 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-a9f0d218-f12f-43d6-99dd-0f9abb0d30e7 tempest-VolumesSnapshotTestJSON-503274425 None] Deleted volume successfully. Feb 27 02:09:12 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a9f0d218-f12f-43d6-99dd-0f9abb0d30e7 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-ae69f693-a6a3-45f4-b113-f2c2f2433e2b-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:12 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-d3379165-46d5-4a69-b6ae-c8f1de8009ba-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:12 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-d3379165-46d5-4a69-b6ae-c8f1de8009ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:12 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-quobyte-fa54fff0-90c1-4786-a242-84012a59875a" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:12 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-fa54fff0-90c1-4786-a242-84012a59875a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:12 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-quobyte-d3379165-46d5-4a69-b6ae-c8f1de8009ba" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:12 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-d3379165-46d5-4a69-b6ae-c8f1de8009ba" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] Deleting offline snapshot d3379165-46d5-4a69-b6ae-c8f1de8009ba of volume fa54fff0-90c1-4786-a242-84012a59875a {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:09:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] snapshot_file for this snap is: volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:09:12 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8efb850-ff5b-447b-9d1a-2a767ccc8e4a]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:12 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4" returned: 0 in 0.727s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:12 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78 1G Feb 27 02:09:12 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:12 devstack sudo[88587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba Feb 27 02:09:12 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:13 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba" returned: 0 in 0.607s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa54fff0-90c1-4786-a242-84012a59875a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:13 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[4403b8f6-236c-411e-8e1e-f3ade9a52a5a]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:13 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78 1G" returned: 0 in 0.627s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:13 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a Feb 27 02:09:13 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78 Feb 27 02:09:13 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:13 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:13 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78" returned: 0 in 0.527s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:13 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78 is being set with open permissions: ugo+rw Feb 27 02:09:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:13 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78 Feb 27 02:09:13 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:13 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a" returned: 0 in 0.724s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:13 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba Feb 27 02:09:13 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:14 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78" returned: 0 in 0.477s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:14 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.info Feb 27 02:09:14 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:14 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba" returned: 0 in 0.687s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:14 devstack sudo[88618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba Feb 27 02:09:14 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:14 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.info" returned: 0 in 0.461s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:14 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.info is being set with open permissions: ugo+rw Feb 27 02:09:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:14 devstack sudo[88621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.info Feb 27 02:09:14 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:15 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a.d3379165-46d5-4a69-b6ae-c8f1de8009ba" returned: 0 in 0.584s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:15 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.info" returned: 0 in 0.474s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "cinder-quobyte-58dd0abb-3e09-4ef0-acd7-04a8ab73442c" by "_copy_volume_from_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-d3379165-46d5-4a69-b6ae-c8f1de8009ba" released by "_delete_snapshot" :: held 2.686s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-fa54fff0-90c1-4786-a242-84012a59875a" released by "delete_snapshot" :: held 2.709s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-quobyte-58dd0abb-3e09-4ef0-acd7-04a8ab73442c" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] snapshot: f1964a28-b43f-40c0-b60e-845713e41a78, volume: 58dd0abb-3e09-4ef0-acd7-04a8ab73442c, {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e47a32c-da17-470d-aac9-a6020b54464e]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] Created reservations ['3a7fc0cb-5aef-4a8f-a454-10c6dbf4993e', '386a62a5-13a4-4426-ac9c-a9f9d4d10aa0', 'f36f7c31-3ba5-4f95-a7e8-ab5c390c330d', '30c77d60-9757-42a1-b82d-08d5c95bd585'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:15 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] Delete snapshot completed successfully. Feb 27 02:09:15 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78 Feb 27 02:09:15 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-dbc336cf-a0e6-4441-af28-580e23fe3084 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-d3379165-46d5-4a69-b6ae-c8f1de8009ba-delete_snapshot" released by "delete_snapshot" :: held 2.863s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-98af5a64-18cc-4bff-8156-28d5fc5851b4 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-fa54fff0-90c1-4786-a242-84012a59875a-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-98af5a64-18cc-4bff-8156-28d5fc5851b4 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-fa54fff0-90c1-4786-a242-84012a59875a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:15 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78" returned: 0 in 0.548s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad258b1e-f525-428b-9413-b41eba3b4ae4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Creating direct copy from snapshot {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-98af5a64-18cc-4bff-8156-28d5fc5851b4 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-quobyte-fa54fff0-90c1-4786-a242-84012a59875a" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31ad8d4-1f19-47e8-992a-8c53a90c9611]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-98af5a64-18cc-4bff-8156-28d5fc5851b4 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-fa54fff0-90c1-4786-a242-84012a59875a" acquired by "delete_volume" :: waited 0.022s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36fe462-f666-4ae3-9d48-b26dd2857534]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-98af5a64-18cc-4bff-8156-28d5fc5851b4 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:15 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 Feb 27 02:09:15 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:15 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a Feb 27 02:09:15 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:16 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4" returned: 0 in 0.538s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:16 devstack cinder-volume[82738]: DEBUG cinder.utils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Path /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-58dd0abb-3e09-4ef0-acd7-04a8ab73442c not found in is_blk_device check {{(pid=82738) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:09:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-58dd0abb-3e09-4ef0-acd7-04a8ab73442c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:16 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-58dd0abb-3e09-4ef0-acd7-04a8ab73442c Feb 27 02:09:16 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:16 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-98af5a64-18cc-4bff-8156-28d5fc5851b4 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a" returned: 0 in 0.744s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-98af5a64-18cc-4bff-8156-28d5fc5851b4 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:16 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a Feb 27 02:09:16 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:17 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-98af5a64-18cc-4bff-8156-28d5fc5851b4 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-fa54fff0-90c1-4786-a242-84012a59875a" returned: 0 in 1.016s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:17 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-98af5a64-18cc-4bff-8156-28d5fc5851b4 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-fa54fff0-90c1-4786-a242-84012a59875a" released by "delete_volume" :: held 1.802s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:17 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-98af5a64-18cc-4bff-8156-28d5fc5851b4 tempest-VolumesSnapshotTestJSON-503274425 None] Created reservations ['e72625b3-296a-4c68-bc0d-fdd2bb0ebb9e', '812e594f-4f3d-42b4-9d09-dcd6061caf27', '020a0fbf-1a14-4434-90f1-1c609b0b9f90', '10552e2b-fb03-44fd-be4f-7d26c3602985'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-98af5a64-18cc-4bff-8156-28d5fc5851b4 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-98af5a64-18cc-4bff-8156-28d5fc5851b4 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:17 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-98af5a64-18cc-4bff-8156-28d5fc5851b4 tempest-VolumesSnapshotTestJSON-503274425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:17 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-98af5a64-18cc-4bff-8156-28d5fc5851b4 tempest-VolumesSnapshotTestJSON-503274425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-98af5a64-18cc-4bff-8156-28d5fc5851b4 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-98af5a64-18cc-4bff-8156-28d5fc5851b4 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:17 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:09:17 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-95a69937-5bab-4de5-a2e6-30371bb71ca1 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-00a0492d-017c-4446-88ee-0d4755a74a0e-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-95a69937-5bab-4de5-a2e6-30371bb71ca1 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-00a0492d-017c-4446-88ee-0d4755a74a0e-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-95a69937-5bab-4de5-a2e6-30371bb71ca1 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "cinder-quobyte-00a0492d-017c-4446-88ee-0d4755a74a0e" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-95a69937-5bab-4de5-a2e6-30371bb71ca1 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-00a0492d-017c-4446-88ee-0d4755a74a0e" acquired by "delete_volume" :: waited 0.028s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:18 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26eb95f-eee9-4040-a5ba-5d9aefeaf8af]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-95a69937-5bab-4de5-a2e6-30371bb71ca1 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:19 devstack sudo[88687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e Feb 27 02:09:19 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:19 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-98af5a64-18cc-4bff-8156-28d5fc5851b4 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 1.656s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:19 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-98af5a64-18cc-4bff-8156-28d5fc5851b4 tempest-VolumesSnapshotTestJSON-503274425 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:19 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-98af5a64-18cc-4bff-8156-28d5fc5851b4 tempest-VolumesSnapshotTestJSON-503274425 None] Deleted volume successfully. Feb 27 02:09:19 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-98af5a64-18cc-4bff-8156-28d5fc5851b4 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-fa54fff0-90c1-4786-a242-84012a59875a-delete_volume" released by "delete_volume" :: held 3.912s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:19 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-58dd0abb-3e09-4ef0-acd7-04a8ab73442c" returned: 0 in 3.430s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:19 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f331dca-b615-4508-a1c2-4dfb79367a8b]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:19 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 Feb 27 02:09:19 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:20 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-95a69937-5bab-4de5-a2e6-30371bb71ca1 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e" returned: 0 in 1.254s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-95a69937-5bab-4de5-a2e6-30371bb71ca1 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:20 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e Feb 27 02:09:20 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:20 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4" returned: 0 in 0.775s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4, size 1024.00 MB, duration 3.43 sec, destination /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-58dd0abb-3e09-4ef0-acd7-04a8ab73442c {{(pid=82738) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:09:20 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Converted 1024.00 MB image at 298.49 MB/s Feb 27 02:09:20 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-58dd0abb-3e09-4ef0-acd7-04a8ab73442c is being set with open permissions: ugo+rw Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-58dd0abb-3e09-4ef0-acd7-04a8ab73442c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:20 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-95a69937-5bab-4de5-a2e6-30371bb71ca1 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-00a0492d-017c-4446-88ee-0d4755a74a0e" returned: 0 in 0.460s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:20 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-58dd0abb-3e09-4ef0-acd7-04a8ab73442c Feb 27 02:09:20 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-95a69937-5bab-4de5-a2e6-30371bb71ca1 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-quobyte-00a0492d-017c-4446-88ee-0d4755a74a0e" released by "delete_volume" :: held 1.810s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-95a69937-5bab-4de5-a2e6-30371bb71ca1 tempest-VolumesSnapshotTestJSON-503274425 None] Created reservations ['eb64b107-e049-46be-94c3-f0fb8fa91370', 'c0533159-baf6-49a3-87ed-278a750d3cda', '3782b155-d9f4-4200-9db0-047da490410c', '371a1ef1-722d-4a13-bd75-14bbd4eee2aa'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-95a69937-5bab-4de5-a2e6-30371bb71ca1 tempest-VolumesSnapshotTestJSON-503274425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-95a69937-5bab-4de5-a2e6-30371bb71ca1 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-95a69937-5bab-4de5-a2e6-30371bb71ca1 tempest-VolumesSnapshotTestJSON-503274425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-95a69937-5bab-4de5-a2e6-30371bb71ca1 tempest-VolumesSnapshotTestJSON-503274425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-95a69937-5bab-4de5-a2e6-30371bb71ca1 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-95a69937-5bab-4de5-a2e6-30371bb71ca1 tempest-VolumesSnapshotTestJSON-503274425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:20 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:09:20 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:20 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-58dd0abb-3e09-4ef0-acd7-04a8ab73442c" returned: 0 in 0.471s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-quobyte-58dd0abb-3e09-4ef0-acd7-04a8ab73442c" released by "_copy_volume_from_snapshot" :: held 5.820s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "cinder-quobyte-f1964a28-b43f-40c0-b60e-845713e41a78" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-quobyte-f1964a28-b43f-40c0-b60e-845713e41a78" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Deleting offline snapshot f1964a28-b43f-40c0-b60e-845713e41a78 of volume ad258b1e-f525-428b-9413-b41eba3b4ae4 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] snapshot_file for this snap is: volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0693e1-d1b3-427e-8003-a9e96eaf016a]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:21 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78 Feb 27 02:09:21 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:21 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-95a69937-5bab-4de5-a2e6-30371bb71ca1 tempest-VolumesSnapshotTestJSON-503274425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.537s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:21 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-95a69937-5bab-4de5-a2e6-30371bb71ca1 tempest-VolumesSnapshotTestJSON-503274425 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:21 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-95a69937-5bab-4de5-a2e6-30371bb71ca1 tempest-VolumesSnapshotTestJSON-503274425 None] Deleted volume successfully. Feb 27 02:09:21 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-95a69937-5bab-4de5-a2e6-30371bb71ca1 tempest-VolumesSnapshotTestJSON-503274425 None] Lock "cinder-00a0492d-017c-4446-88ee-0d4755a74a0e-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:21 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78" returned: 0 in 0.592s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:21 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad258b1e-f525-428b-9413-b41eba3b4ae4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:21 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb59bab-2fac-4909-8b06-1bba1654af3d]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:21 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 Feb 27 02:09:21 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:22 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4" returned: 0 in 0.542s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:22 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78 Feb 27 02:09:22 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:22 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78" returned: 0 in 0.562s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:22 devstack sudo[88761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78 Feb 27 02:09:22 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:23 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4.f1964a28-b43f-40c0-b60e-845713e41a78" returned: 0 in 0.512s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:23 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-quobyte-f1964a28-b43f-40c0-b60e-845713e41a78" released by "_delete_snapshot" :: held 2.269s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.567s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb19b503-ab87-4349-8f30-8eeddb464f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58dd0abb-3e09-4ef0-acd7-04a8ab73442c', 'volume_size': 1, 'source_volid': 'ad258b1e-f525-428b-9413-b41eba3b4ae4', 'source_volstatus': 'available'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0c43e6-c67b-41ff-a0cf-c3419701020a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:23 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Volume volume-58dd0abb-3e09-4ef0-acd7-04a8ab73442c (58dd0abb-3e09-4ef0-acd7-04a8ab73442c): created successfully Feb 27 02:09:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0c43e6-c67b-41ff-a0cf-c3419701020a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Flow 'volume_create_manager' (288fd2d7-7a9f-4cf7-be51-c73c9777c3da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:23 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-69c3571e-cfb6-4ee1-91c1-a689c3b7b45e tempest-VolumeDependencyTests-1173424542 None] Created volume successfully. Feb 27 02:09:23 devstack cinder-volume[82738]: DEBUG oslo_service.periodic_task [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82738) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:09:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:23 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:09:23 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:23 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c657e9bc-3737-49ba-b63d-4cdd7e4dd092 tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "cinder-ad258b1e-f525-428b-9413-b41eba3b4ae4-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:23 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c657e9bc-3737-49ba-b63d-4cdd7e4dd092 tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-ad258b1e-f525-428b-9413-b41eba3b4ae4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:23 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c657e9bc-3737-49ba-b63d-4cdd7e4dd092 tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "cinder-quobyte-ad258b1e-f525-428b-9413-b41eba3b4ae4" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:24 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c657e9bc-3737-49ba-b63d-4cdd7e4dd092 tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-quobyte-ad258b1e-f525-428b-9413-b41eba3b4ae4" acquired by "delete_volume" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:24 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c948e7-3aac-41cc-b5c8-d92c32832407]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c657e9bc-3737-49ba-b63d-4cdd7e4dd092 tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:24 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 Feb 27 02:09:24 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:24 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.724s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:24 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:24 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c657e9bc-3737-49ba-b63d-4cdd7e4dd092 tempest-VolumeDependencyTests-1173424542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4" returned: 0 in 0.726s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c657e9bc-3737-49ba-b63d-4cdd7e4dd092 tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:24 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4 Feb 27 02:09:24 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:25 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c657e9bc-3737-49ba-b63d-4cdd7e4dd092 tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad258b1e-f525-428b-9413-b41eba3b4ae4" returned: 0 in 0.577s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c657e9bc-3737-49ba-b63d-4cdd7e4dd092 tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-quobyte-ad258b1e-f525-428b-9413-b41eba3b4ae4" released by "delete_volume" :: held 1.347s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:25 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-c657e9bc-3737-49ba-b63d-4cdd7e4dd092 tempest-VolumeDependencyTests-1173424542 None] Created reservations ['458fb68c-8e73-41d3-ab25-6ec85f66c1a6', 'd6e57b24-05cb-44d5-93aa-893420a8a141', '452d9f43-016b-44c9-bfdc-62265a527127', 'f0ae0b10-3e85-4c18-bb02-e2edf73af82b'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c657e9bc-3737-49ba-b63d-4cdd7e4dd092 tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c657e9bc-3737-49ba-b63d-4cdd7e4dd092 tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:25 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-c657e9bc-3737-49ba-b63d-4cdd7e4dd092 tempest-VolumeDependencyTests-1173424542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:25 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-c657e9bc-3737-49ba-b63d-4cdd7e4dd092 tempest-VolumeDependencyTests-1173424542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c657e9bc-3737-49ba-b63d-4cdd7e4dd092 tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c657e9bc-3737-49ba-b63d-4cdd7e4dd092 tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:25 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:09:25 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:26 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c657e9bc-3737-49ba-b63d-4cdd7e4dd092 tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.543s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:26 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-c657e9bc-3737-49ba-b63d-4cdd7e4dd092 tempest-VolumeDependencyTests-1173424542 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:26 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-c657e9bc-3737-49ba-b63d-4cdd7e4dd092 tempest-VolumeDependencyTests-1173424542 None] Deleted volume successfully. Feb 27 02:09:26 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c657e9bc-3737-49ba-b63d-4cdd7e4dd092 tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-ad258b1e-f525-428b-9413-b41eba3b4ae4-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:26 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0e079f8-e701-43e8-8304-2dfc8d1dd560 tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "cinder-58dd0abb-3e09-4ef0-acd7-04a8ab73442c-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:26 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0e079f8-e701-43e8-8304-2dfc8d1dd560 tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-58dd0abb-3e09-4ef0-acd7-04a8ab73442c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:26 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0e079f8-e701-43e8-8304-2dfc8d1dd560 tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "cinder-quobyte-58dd0abb-3e09-4ef0-acd7-04a8ab73442c" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:26 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0e079f8-e701-43e8-8304-2dfc8d1dd560 tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-quobyte-58dd0abb-3e09-4ef0-acd7-04a8ab73442c" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:26 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[b317cf18-788b-4cc3-999e-ef6f27f1f31f]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e0e079f8-e701-43e8-8304-2dfc8d1dd560 tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-58dd0abb-3e09-4ef0-acd7-04a8ab73442c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:26 devstack sudo[88783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-58dd0abb-3e09-4ef0-acd7-04a8ab73442c Feb 27 02:09:26 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:26 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e0e079f8-e701-43e8-8304-2dfc8d1dd560 tempest-VolumeDependencyTests-1173424542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-58dd0abb-3e09-4ef0-acd7-04a8ab73442c" returned: 0 in 0.625s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e0e079f8-e701-43e8-8304-2dfc8d1dd560 tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-58dd0abb-3e09-4ef0-acd7-04a8ab73442c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:26 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-58dd0abb-3e09-4ef0-acd7-04a8ab73442c Feb 27 02:09:26 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:27 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e0e079f8-e701-43e8-8304-2dfc8d1dd560 tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-58dd0abb-3e09-4ef0-acd7-04a8ab73442c" returned: 0 in 0.477s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:27 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0e079f8-e701-43e8-8304-2dfc8d1dd560 tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-quobyte-58dd0abb-3e09-4ef0-acd7-04a8ab73442c" released by "delete_volume" :: held 1.131s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:27 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-e0e079f8-e701-43e8-8304-2dfc8d1dd560 tempest-VolumeDependencyTests-1173424542 None] Created reservations ['f8202536-9dc6-4d15-ae2c-c81ad9e85449', 'c2739fd8-999c-48e5-b76d-85d2e5c60c56', '7f892b5d-e514-4f8f-bd55-f0b7356cf616', 'ce0af877-0fb6-4bb0-b978-41ce609a462e'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e0e079f8-e701-43e8-8304-2dfc8d1dd560 tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e0e079f8-e701-43e8-8304-2dfc8d1dd560 tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:27 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e0e079f8-e701-43e8-8304-2dfc8d1dd560 tempest-VolumeDependencyTests-1173424542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:27 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e0e079f8-e701-43e8-8304-2dfc8d1dd560 tempest-VolumeDependencyTests-1173424542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e0e079f8-e701-43e8-8304-2dfc8d1dd560 tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e0e079f8-e701-43e8-8304-2dfc8d1dd560 tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:27 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:09:27 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:27 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e0e079f8-e701-43e8-8304-2dfc8d1dd560 tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.487s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:27 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-e0e079f8-e701-43e8-8304-2dfc8d1dd560 tempest-VolumeDependencyTests-1173424542 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:27 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e0e079f8-e701-43e8-8304-2dfc8d1dd560 tempest-VolumeDependencyTests-1173424542 None] Deleted volume successfully. Feb 27 02:09:27 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0e079f8-e701-43e8-8304-2dfc8d1dd560 tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-58dd0abb-3e09-4ef0-acd7-04a8ab73442c-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:28 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-25767e7e-5678-4222-b4d9-edfce86f5e56 tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "cinder-9f02afb4-dfcc-403a-b7f9-0f2931a4df44-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:28 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-25767e7e-5678-4222-b4d9-edfce86f5e56 tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-9f02afb4-dfcc-403a-b7f9-0f2931a4df44-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:28 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-25767e7e-5678-4222-b4d9-edfce86f5e56 tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "cinder-quobyte-9f02afb4-dfcc-403a-b7f9-0f2931a4df44" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:28 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-25767e7e-5678-4222-b4d9-edfce86f5e56 tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-quobyte-9f02afb4-dfcc-403a-b7f9-0f2931a4df44" acquired by "delete_volume" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:28 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc47b45-9090-443d-a88b-4e8da2f1e896]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-25767e7e-5678-4222-b4d9-edfce86f5e56 tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9f02afb4-dfcc-403a-b7f9-0f2931a4df44 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:28 devstack sudo[88795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9f02afb4-dfcc-403a-b7f9-0f2931a4df44 Feb 27 02:09:28 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:29 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-25767e7e-5678-4222-b4d9-edfce86f5e56 tempest-VolumeDependencyTests-1173424542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9f02afb4-dfcc-403a-b7f9-0f2931a4df44" returned: 0 in 0.572s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-25767e7e-5678-4222-b4d9-edfce86f5e56 tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9f02afb4-dfcc-403a-b7f9-0f2931a4df44 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:29 devstack sudo[88800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9f02afb4-dfcc-403a-b7f9-0f2931a4df44 Feb 27 02:09:29 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:29 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-25767e7e-5678-4222-b4d9-edfce86f5e56 tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-9f02afb4-dfcc-403a-b7f9-0f2931a4df44" returned: 0 in 0.491s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-25767e7e-5678-4222-b4d9-edfce86f5e56 tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-quobyte-9f02afb4-dfcc-403a-b7f9-0f2931a4df44" released by "delete_volume" :: held 1.093s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-25767e7e-5678-4222-b4d9-edfce86f5e56 tempest-VolumeDependencyTests-1173424542 None] Created reservations ['6f5106aa-5202-49a0-8750-3021ee053078', '6b10bc19-b32c-4fb0-8454-31df2a81e3e8', '0657bbc4-2d15-438c-89e3-0b016a966463', '59b782e6-5f8f-4a30-8682-c3f1eac64d3d'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-25767e7e-5678-4222-b4d9-edfce86f5e56 tempest-VolumeDependencyTests-1173424542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-25767e7e-5678-4222-b4d9-edfce86f5e56 tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-25767e7e-5678-4222-b4d9-edfce86f5e56 tempest-VolumeDependencyTests-1173424542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-25767e7e-5678-4222-b4d9-edfce86f5e56 tempest-VolumeDependencyTests-1173424542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-25767e7e-5678-4222-b4d9-edfce86f5e56 tempest-VolumeDependencyTests-1173424542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-25767e7e-5678-4222-b4d9-edfce86f5e56 tempest-VolumeDependencyTests-1173424542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:29 devstack sudo[88803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:09:29 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Flow 'volume_create_manager' (c5af081e-5170-4008-bc11-d90b669d248c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c8dbff-cbc2-4278-afea-959ccc774455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c8dbff-cbc2-4278-afea-959ccc774455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1674942263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec600a7-e01b-4c51-9708-3ebaefb8f193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8669593ea77444a88f658c8030efdebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:30Z,use_quota=True,user_id='fd8da84766d640208615aca785c16b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f042d669-be5d-4c7a-a9d6-61df88ec7282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f042d669-be5d-4c7a-a9d6-61df88ec7282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d782ce91-9401-42db-a06f-ac822097596b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d782ce91-9401-42db-a06f-ac822097596b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec600a7-e01b-4c51-9708-3ebaefb8f193', 'volume_name': 'volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fecce3f-245e-4753-906a-8eea2b708a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fecce3f-245e-4753-906a-8eea2b708a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a57a6e7-a896-4c41-b973-ae68fa07a1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:29 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Volume 0ec600a7-e01b-4c51-9708-3ebaefb8f193: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193', 'volume_size': 1} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1674942263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec600a7-e01b-4c51-9708-3ebaefb8f193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8669593ea77444a88f658c8030efdebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:30Z,use_quota=True,user_id='fd8da84766d640208615aca785c16b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Creating volume 0ec600a7-e01b-4c51-9708-3ebaefb8f193 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:29 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:09:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:30 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193 1073741824 Feb 27 02:09:30 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:30 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-25767e7e-5678-4222-b4d9-edfce86f5e56 tempest-VolumeDependencyTests-1173424542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.453s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:30 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-25767e7e-5678-4222-b4d9-edfce86f5e56 tempest-VolumeDependencyTests-1173424542 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:30 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-25767e7e-5678-4222-b4d9-edfce86f5e56 tempest-VolumeDependencyTests-1173424542 None] Deleted volume successfully. Feb 27 02:09:30 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-25767e7e-5678-4222-b4d9-edfce86f5e56 tempest-VolumeDependencyTests-1173424542 None] Lock "cinder-9f02afb4-dfcc-403a-b7f9-0f2931a4df44-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:30 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193 1073741824" returned: 0 in 0.531s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:30 devstack sudo[88812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193 Feb 27 02:09:30 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:31 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193" returned: 0 in 0.504s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:31 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:31 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a57a6e7-a896-4c41-b973-ae68fa07a1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:31 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9580152f-72db-4ef5-9464-b5a73f99049e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:31 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Volume volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193 (0ec600a7-e01b-4c51-9708-3ebaefb8f193): created successfully Feb 27 02:09:31 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9580152f-72db-4ef5-9464-b5a73f99049e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:31 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Flow 'volume_create_manager' (c5af081e-5170-4008-bc11-d90b669d248c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:31 devstack cinder-volume[82738]: INFO cinder.volume.manager [req-64b5ab0b-8e7c-4d4a-95a7-392d576074fb req-a5d97513-6379-42cd-b944-57f7f7cab917 tempest-VolumesSnapshotsTestJSON-286564309 None] Created volume successfully. Feb 27 02:09:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-eaf9a89f-30ac-4880-8344-1348770bea4d req-f42e3e12-8926-4b2c-b06c-57026973a38f tempest-VolumesSnapshotsTestJSON-286564309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-eaf9a89f-30ac-4880-8344-1348770bea4d req-f42e3e12-8926-4b2c-b06c-57026973a38f tempest-VolumesSnapshotsTestJSON-286564309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:32 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [req-eaf9a89f-30ac-4880-8344-1348770bea4d req-f42e3e12-8926-4b2c-b06c-57026973a38f tempest-VolumesSnapshotsTestJSON-286564309 None] Creating offline snapshot fabeea15-445f-4557-a427-c06cc5372fe2 of volume 0ec600a7-e01b-4c51-9708-3ebaefb8f193 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:09:32 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadc7a3e-c495-469e-b9b2-b9dd7a73ffd0]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-eaf9a89f-30ac-4880-8344-1348770bea4d req-f42e3e12-8926-4b2c-b06c-57026973a38f tempest-VolumesSnapshotsTestJSON-286564309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:32 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193 Feb 27 02:09:32 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:32 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Flow 'volume_create_manager' (214288e1-33e8-41b5-a17a-0698b1c616a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c842c7dc-c4b8-4181-a275-567227be0c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c842c7dc-c4b8-4181-a275-567227be0c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a225ca9a-fa86-4d88-9868-358d11492f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3391a117f85846a3b34e0ebf0a57b129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:33Z,use_quota=True,user_id='3a6f44c649ee43ae9b442b3b92581394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc8c60d-68b0-4ab2-9a10-87063180c761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc8c60d-68b0-4ab2-9a10-87063180c761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (551f1bee-4be1-42a6-ab6e-da457ba7d93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (551f1bee-4be1-42a6-ab6e-da457ba7d93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a225ca9a-fa86-4d88-9868-358d11492f0a', 'volume_name': 'volume-a225ca9a-fa86-4d88-9868-358d11492f0a', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4483907d-fd3e-4534-a0c5-38f7e7631a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4483907d-fd3e-4534-a0c5-38f7e7631a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bf044a-b4ae-4603-9940-76f810dd5b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:32 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Volume a225ca9a-fa86-4d88-9868-358d11492f0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a225ca9a-fa86-4d88-9868-358d11492f0a', 'volume_size': 1} Feb 27 02:09:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:32 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-eaf9a89f-30ac-4880-8344-1348770bea4d req-f42e3e12-8926-4b2c-b06c-57026973a38f tempest-VolumesSnapshotsTestJSON-286564309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193" returned: 0 in 0.588s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-eaf9a89f-30ac-4880-8344-1348770bea4d req-f42e3e12-8926-4b2c-b06c-57026973a38f tempest-VolumesSnapshotsTestJSON-286564309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.fabeea15-445f-4557-a427-c06cc5372fe2 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:32 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.fabeea15-445f-4557-a427-c06cc5372fe2 1G Feb 27 02:09:32 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:33 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-eaf9a89f-30ac-4880-8344-1348770bea4d req-f42e3e12-8926-4b2c-b06c-57026973a38f tempest-VolumesSnapshotsTestJSON-286564309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.fabeea15-445f-4557-a427-c06cc5372fe2 1G" returned: 0 in 0.537s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-eaf9a89f-30ac-4880-8344-1348770bea4d req-f42e3e12-8926-4b2c-b06c-57026973a38f tempest-VolumesSnapshotsTestJSON-286564309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.fabeea15-445f-4557-a427-c06cc5372fe2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:33 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.fabeea15-445f-4557-a427-c06cc5372fe2 Feb 27 02:09:33 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:33 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-eaf9a89f-30ac-4880-8344-1348770bea4d req-f42e3e12-8926-4b2c-b06c-57026973a38f tempest-VolumesSnapshotsTestJSON-286564309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.fabeea15-445f-4557-a427-c06cc5372fe2" returned: 0 in 0.485s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:33 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [req-eaf9a89f-30ac-4880-8344-1348770bea4d req-f42e3e12-8926-4b2c-b06c-57026973a38f tempest-VolumesSnapshotsTestJSON-286564309 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.fabeea15-445f-4557-a427-c06cc5372fe2 is being set with open permissions: ugo+rw Feb 27 02:09:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-eaf9a89f-30ac-4880-8344-1348770bea4d req-f42e3e12-8926-4b2c-b06c-57026973a38f tempest-VolumesSnapshotsTestJSON-286564309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.fabeea15-445f-4557-a427-c06cc5372fe2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:33 devstack sudo[88830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.fabeea15-445f-4557-a427-c06cc5372fe2 Feb 27 02:09:33 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:34 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-eaf9a89f-30ac-4880-8344-1348770bea4d req-f42e3e12-8926-4b2c-b06c-57026973a38f tempest-VolumesSnapshotsTestJSON-286564309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.fabeea15-445f-4557-a427-c06cc5372fe2" returned: 0 in 0.467s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-eaf9a89f-30ac-4880-8344-1348770bea4d req-f42e3e12-8926-4b2c-b06c-57026973a38f tempest-VolumesSnapshotsTestJSON-286564309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:34 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.info Feb 27 02:09:34 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:34 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-eaf9a89f-30ac-4880-8344-1348770bea4d req-f42e3e12-8926-4b2c-b06c-57026973a38f tempest-VolumesSnapshotsTestJSON-286564309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.info" returned: 0 in 0.457s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:34 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [req-eaf9a89f-30ac-4880-8344-1348770bea4d req-f42e3e12-8926-4b2c-b06c-57026973a38f tempest-VolumesSnapshotsTestJSON-286564309 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.info is being set with open permissions: ugo+rw Feb 27 02:09:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-eaf9a89f-30ac-4880-8344-1348770bea4d req-f42e3e12-8926-4b2c-b06c-57026973a38f tempest-VolumesSnapshotsTestJSON-286564309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:34 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.info Feb 27 02:09:34 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:35 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-eaf9a89f-30ac-4880-8344-1348770bea4d req-f42e3e12-8926-4b2c-b06c-57026973a38f tempest-VolumesSnapshotsTestJSON-286564309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.info" returned: 0 in 0.449s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-eaf9a89f-30ac-4880-8344-1348770bea4d req-f42e3e12-8926-4b2c-b06c-57026973a38f tempest-VolumesSnapshotsTestJSON-286564309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.054s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.590s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a225ca9a-fa86-4d88-9868-358d11492f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3391a117f85846a3b34e0ebf0a57b129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:33Z,use_quota=True,user_id='3a6f44c649ee43ae9b442b3b92581394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Creating volume a225ca9a-fa86-4d88-9868-358d11492f0a {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:35 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a225ca9a-fa86-4d88-9868-358d11492f0a 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:35 devstack sudo[88839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a225ca9a-fa86-4d88-9868-358d11492f0a 1073741824 Feb 27 02:09:35 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:35 devstack cinder-volume[82738]: INFO cinder.volume.manager [req-eaf9a89f-30ac-4880-8344-1348770bea4d req-f42e3e12-8926-4b2c-b06c-57026973a38f tempest-VolumesSnapshotsTestJSON-286564309 None] Create snapshot completed successfully Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] Acquiring lock "cinder-fabeea15-445f-4557-a427-c06cc5372fe2-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] Lock "cinder-fabeea15-445f-4557-a427-c06cc5372fe2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] Acquiring lock "cinder-quobyte-0ec600a7-e01b-4c51-9708-3ebaefb8f193" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] Lock "cinder-quobyte-0ec600a7-e01b-4c51-9708-3ebaefb8f193" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] Acquiring lock "cinder-quobyte-fabeea15-445f-4557-a427-c06cc5372fe2" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] Lock "cinder-quobyte-fabeea15-445f-4557-a427-c06cc5372fe2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] Deleting offline snapshot fabeea15-445f-4557-a427-c06cc5372fe2 of volume 0ec600a7-e01b-4c51-9708-3ebaefb8f193 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] snapshot_file for this snap is: volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.fabeea15-445f-4557-a427-c06cc5372fe2 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[a187d7cf-f154-4d3c-806c-d17b678f48aa]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.fabeea15-445f-4557-a427-c06cc5372fe2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:35 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.fabeea15-445f-4557-a427-c06cc5372fe2 Feb 27 02:09:35 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:35 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a225ca9a-fa86-4d88-9868-358d11492f0a 1073741824" returned: 0 in 0.589s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a225ca9a-fa86-4d88-9868-358d11492f0a {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:35 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a225ca9a-fa86-4d88-9868-358d11492f0a Feb 27 02:09:35 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:36 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.fabeea15-445f-4557-a427-c06cc5372fe2" returned: 0 in 0.579s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:36 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:36 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8ce1fb-ff80-4011-b3fd-97449c34e944]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:36 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193 Feb 27 02:09:36 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:36 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a225ca9a-fa86-4d88-9868-358d11492f0a" returned: 0 in 0.479s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:36 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:36 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bf044a-b4ae-4603-9940-76f810dd5b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a225ca9a-fa86-4d88-9868-358d11492f0a', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:36 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606febe8-5757-424b-857d-b66ef1e8a86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:36 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Volume volume-a225ca9a-fa86-4d88-9868-358d11492f0a (a225ca9a-fa86-4d88-9868-358d11492f0a): created successfully Feb 27 02:09:36 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606febe8-5757-424b-857d-b66ef1e8a86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:36 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Flow 'volume_create_manager' (214288e1-33e8-41b5-a17a-0698b1c616a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:36 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-901b3830-3071-4845-ae8d-ab031219432a tempest-CinderUnicodeTest-1346930060 None] Created volume successfully. Feb 27 02:09:36 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193" returned: 0 in 0.530s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.fabeea15-445f-4557-a427-c06cc5372fe2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:36 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.fabeea15-445f-4557-a427-c06cc5372fe2 Feb 27 02:09:36 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Flow 'volume_create_manager' (efb26d51-0552-451d-a8cd-8cd5d2032482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad558f30-8850-487c-bae3-b7a9ba7914d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad558f30-8850-487c-bae3-b7a9ba7914d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-213124744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312fd3d0-e038-44b2-947f-8d6b98020850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3391a117f85846a3b34e0ebf0a57b129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:37Z,use_quota=True,user_id='3a6f44c649ee43ae9b442b3b92581394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de46167f-dd61-4532-9164-c62032e912b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de46167f-dd61-4532-9164-c62032e912b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21957393-61bd-486c-8986-7150b0134bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21957393-61bd-486c-8986-7150b0134bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '312fd3d0-e038-44b2-947f-8d6b98020850', 'volume_name': 'volume-312fd3d0-e038-44b2-947f-8d6b98020850', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49459ba-ac3b-4480-8380-efccab4f550b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49459ba-ac3b-4480-8380-efccab4f550b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bc145c-7140-43ce-bb09-3c66f9ccc4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:37 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Volume 312fd3d0-e038-44b2-947f-8d6b98020850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-312fd3d0-e038-44b2-947f-8d6b98020850', 'volume_size': 1} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-213124744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312fd3d0-e038-44b2-947f-8d6b98020850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3391a117f85846a3b34e0ebf0a57b129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:37Z,use_quota=True,user_id='3a6f44c649ee43ae9b442b3b92581394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Creating volume 312fd3d0-e038-44b2-947f-8d6b98020850 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:37 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:37 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850 1073741824 Feb 27 02:09:37 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:37 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.fabeea15-445f-4557-a427-c06cc5372fe2" returned: 0 in 0.571s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.fabeea15-445f-4557-a427-c06cc5372fe2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:37 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.fabeea15-445f-4557-a427-c06cc5372fe2 Feb 27 02:09:37 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:37 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193.fabeea15-445f-4557-a427-c06cc5372fe2" returned: 0 in 0.495s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] Lock "cinder-quobyte-fabeea15-445f-4557-a427-c06cc5372fe2" released by "_delete_snapshot" :: held 2.255s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] Lock "cinder-quobyte-0ec600a7-e01b-4c51-9708-3ebaefb8f193" released by "delete_snapshot" :: held 2.275s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:37 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850 1073741824" returned: 0 in 0.604s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:37 devstack cinder-volume[82738]: DEBUG cinder.quota [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] Created reservations ['2bc64370-8592-4d93-a611-c0465a025e81', 'df4ba2aa-9496-484f-a45f-0e8596ad30f9', '55dba8b2-f493-44d5-b047-f7f9eddeeb72', 'd38cb4bc-5f00-4860-aa70-75675ee789ad'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:37 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850 Feb 27 02:09:37 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:38 devstack cinder-volume[82738]: INFO cinder.volume.manager [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] Delete snapshot completed successfully. Feb 27 02:09:38 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-66d4cb80-003d-470d-8439-cb5d7550bd02 req-5a5fc842-20d0-4a5c-8359-bf677c581252 tempest-VolumesSnapshotsTestJSON-286564309 None] Lock "cinder-fabeea15-445f-4557-a427-c06cc5372fe2-delete_snapshot" released by "delete_snapshot" :: held 2.427s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:38 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850" returned: 0 in 0.509s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:38 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:38 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bc145c-7140-43ce-bb09-3c66f9ccc4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-312fd3d0-e038-44b2-947f-8d6b98020850', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:38 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3966118a-84a7-429b-a43a-64de244a634c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:38 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Volume volume-312fd3d0-e038-44b2-947f-8d6b98020850 (312fd3d0-e038-44b2-947f-8d6b98020850): created successfully Feb 27 02:09:38 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3966118a-84a7-429b-a43a-64de244a634c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:38 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Flow 'volume_create_manager' (efb26d51-0552-451d-a8cd-8cd5d2032482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:38 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-9dfecd17-0603-4edd-aa24-dc7c4c3947db tempest-CinderUnicodeTest-1346930060 None] Created volume successfully. Feb 27 02:09:38 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-2d61a94e-94b4-4ef6-9746-86882acb47f7 req-988e4c13-da5e-4a9e-9a22-5ea72d6035a5 tempest-VolumesSnapshotsTestJSON-286564309 None] Acquiring lock "cinder-0ec600a7-e01b-4c51-9708-3ebaefb8f193-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:38 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-2d61a94e-94b4-4ef6-9746-86882acb47f7 req-988e4c13-da5e-4a9e-9a22-5ea72d6035a5 tempest-VolumesSnapshotsTestJSON-286564309 None] Lock "cinder-0ec600a7-e01b-4c51-9708-3ebaefb8f193-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:38 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-2d61a94e-94b4-4ef6-9746-86882acb47f7 req-988e4c13-da5e-4a9e-9a22-5ea72d6035a5 tempest-VolumesSnapshotsTestJSON-286564309 None] Acquiring lock "cinder-quobyte-0ec600a7-e01b-4c51-9708-3ebaefb8f193" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:38 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-2d61a94e-94b4-4ef6-9746-86882acb47f7 req-988e4c13-da5e-4a9e-9a22-5ea72d6035a5 tempest-VolumesSnapshotsTestJSON-286564309 None] Lock "cinder-quobyte-0ec600a7-e01b-4c51-9708-3ebaefb8f193" acquired by "delete_volume" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:38 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b9f410-5a5c-41b5-a004-e73aaccfdc99]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-2d61a94e-94b4-4ef6-9746-86882acb47f7 req-988e4c13-da5e-4a9e-9a22-5ea72d6035a5 tempest-VolumesSnapshotsTestJSON-286564309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:39 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193 Feb 27 02:09:39 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:39 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-2d61a94e-94b4-4ef6-9746-86882acb47f7 req-988e4c13-da5e-4a9e-9a22-5ea72d6035a5 tempest-VolumesSnapshotsTestJSON-286564309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193" returned: 0 in 0.642s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-2d61a94e-94b4-4ef6-9746-86882acb47f7 req-988e4c13-da5e-4a9e-9a22-5ea72d6035a5 tempest-VolumesSnapshotsTestJSON-286564309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:39 devstack sudo[88878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193 Feb 27 02:09:39 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-16ba823b-b660-4a76-9bae-16c6c62debdf tempest-CinderUnicodeTest-1346930060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-16ba823b-b660-4a76-9bae-16c6c62debdf tempest-CinderUnicodeTest-1346930060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:39 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-16ba823b-b660-4a76-9bae-16c6c62debdf tempest-CinderUnicodeTest-1346930060 None] Creating offline snapshot 9f473483-6671-4837-827b-6a151202ba94 of volume 312fd3d0-e038-44b2-947f-8d6b98020850 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:09:39 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade80bd7-7fe6-4ae4-8b67-0a962c2bfcaf]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-16ba823b-b660-4a76-9bae-16c6c62debdf tempest-CinderUnicodeTest-1346930060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:39 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850 Feb 27 02:09:39 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:40 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-2d61a94e-94b4-4ef6-9746-86882acb47f7 req-988e4c13-da5e-4a9e-9a22-5ea72d6035a5 tempest-VolumesSnapshotsTestJSON-286564309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0ec600a7-e01b-4c51-9708-3ebaefb8f193" returned: 0 in 0.489s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:40 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-2d61a94e-94b4-4ef6-9746-86882acb47f7 req-988e4c13-da5e-4a9e-9a22-5ea72d6035a5 tempest-VolumesSnapshotsTestJSON-286564309 None] Lock "cinder-quobyte-0ec600a7-e01b-4c51-9708-3ebaefb8f193" released by "delete_volume" :: held 1.178s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:40 devstack cinder-volume[82738]: DEBUG cinder.quota [req-2d61a94e-94b4-4ef6-9746-86882acb47f7 req-988e4c13-da5e-4a9e-9a22-5ea72d6035a5 tempest-VolumesSnapshotsTestJSON-286564309 None] Created reservations ['7a87664d-7e84-47db-9bf2-52c3b39d30bf', '385778ee-6954-4ffa-a682-77aaab2f8f8a', '2ff71003-aca1-455c-8aa3-4cd10b7ad058', 'bc0ca584-543a-46a0-b6da-8e763f606563'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-2d61a94e-94b4-4ef6-9746-86882acb47f7 req-988e4c13-da5e-4a9e-9a22-5ea72d6035a5 tempest-VolumesSnapshotsTestJSON-286564309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-2d61a94e-94b4-4ef6-9746-86882acb47f7 req-988e4c13-da5e-4a9e-9a22-5ea72d6035a5 tempest-VolumesSnapshotsTestJSON-286564309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:40 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-2d61a94e-94b4-4ef6-9746-86882acb47f7 req-988e4c13-da5e-4a9e-9a22-5ea72d6035a5 tempest-VolumesSnapshotsTestJSON-286564309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:40 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [req-2d61a94e-94b4-4ef6-9746-86882acb47f7 req-988e4c13-da5e-4a9e-9a22-5ea72d6035a5 tempest-VolumesSnapshotsTestJSON-286564309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [req-2d61a94e-94b4-4ef6-9746-86882acb47f7 req-988e4c13-da5e-4a9e-9a22-5ea72d6035a5 tempest-VolumesSnapshotsTestJSON-286564309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-2d61a94e-94b4-4ef6-9746-86882acb47f7 req-988e4c13-da5e-4a9e-9a22-5ea72d6035a5 tempest-VolumesSnapshotsTestJSON-286564309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:40 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:09:40 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:40 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-16ba823b-b660-4a76-9bae-16c6c62debdf tempest-CinderUnicodeTest-1346930060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850" returned: 0 in 0.640s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-16ba823b-b660-4a76-9bae-16c6c62debdf tempest-CinderUnicodeTest-1346930060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.9f473483-6671-4837-827b-6a151202ba94 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:40 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.9f473483-6671-4837-827b-6a151202ba94 1G Feb 27 02:09:40 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:40 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [req-2d61a94e-94b4-4ef6-9746-86882acb47f7 req-988e4c13-da5e-4a9e-9a22-5ea72d6035a5 tempest-VolumesSnapshotsTestJSON-286564309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.550s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:40 devstack cinder-volume[82738]: DEBUG cinder.manager [req-2d61a94e-94b4-4ef6-9746-86882acb47f7 req-988e4c13-da5e-4a9e-9a22-5ea72d6035a5 tempest-VolumesSnapshotsTestJSON-286564309 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:40 devstack cinder-volume[82738]: INFO cinder.volume.manager [req-2d61a94e-94b4-4ef6-9746-86882acb47f7 req-988e4c13-da5e-4a9e-9a22-5ea72d6035a5 tempest-VolumesSnapshotsTestJSON-286564309 None] Deleted volume successfully. Feb 27 02:09:40 devstack cinder-volume[82738]: DEBUG cinder.coordination [req-2d61a94e-94b4-4ef6-9746-86882acb47f7 req-988e4c13-da5e-4a9e-9a22-5ea72d6035a5 tempest-VolumesSnapshotsTestJSON-286564309 None] Lock "cinder-0ec600a7-e01b-4c51-9708-3ebaefb8f193-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:40 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-16ba823b-b660-4a76-9bae-16c6c62debdf tempest-CinderUnicodeTest-1346930060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.9f473483-6671-4837-827b-6a151202ba94 1G" returned: 0 in 0.622s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-16ba823b-b660-4a76-9bae-16c6c62debdf tempest-CinderUnicodeTest-1346930060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-312fd3d0-e038-44b2-947f-8d6b98020850 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.9f473483-6671-4837-827b-6a151202ba94 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:40 devstack sudo[88895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-312fd3d0-e038-44b2-947f-8d6b98020850 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.9f473483-6671-4837-827b-6a151202ba94 Feb 27 02:09:40 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:41 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-16ba823b-b660-4a76-9bae-16c6c62debdf tempest-CinderUnicodeTest-1346930060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-312fd3d0-e038-44b2-947f-8d6b98020850 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.9f473483-6671-4837-827b-6a151202ba94" returned: 0 in 0.513s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:41 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-16ba823b-b660-4a76-9bae-16c6c62debdf tempest-CinderUnicodeTest-1346930060 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.9f473483-6671-4837-827b-6a151202ba94 is being set with open permissions: ugo+rw Feb 27 02:09:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-16ba823b-b660-4a76-9bae-16c6c62debdf tempest-CinderUnicodeTest-1346930060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.9f473483-6671-4837-827b-6a151202ba94 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:41 devstack sudo[88900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.9f473483-6671-4837-827b-6a151202ba94 Feb 27 02:09:41 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:42 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-16ba823b-b660-4a76-9bae-16c6c62debdf tempest-CinderUnicodeTest-1346930060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.9f473483-6671-4837-827b-6a151202ba94" returned: 0 in 0.577s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-16ba823b-b660-4a76-9bae-16c6c62debdf tempest-CinderUnicodeTest-1346930060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:42 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.info Feb 27 02:09:42 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:42 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-16ba823b-b660-4a76-9bae-16c6c62debdf tempest-CinderUnicodeTest-1346930060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.info" returned: 0 in 0.553s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:42 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-16ba823b-b660-4a76-9bae-16c6c62debdf tempest-CinderUnicodeTest-1346930060 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.info is being set with open permissions: ugo+rw Feb 27 02:09:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-16ba823b-b660-4a76-9bae-16c6c62debdf tempest-CinderUnicodeTest-1346930060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:42 devstack sudo[88906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.info Feb 27 02:09:42 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:43 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-16ba823b-b660-4a76-9bae-16c6c62debdf tempest-CinderUnicodeTest-1346930060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.info" returned: 0 in 0.473s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-16ba823b-b660-4a76-9bae-16c6c62debdf tempest-CinderUnicodeTest-1346930060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.456s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:43 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-16ba823b-b660-4a76-9bae-16c6c62debdf tempest-CinderUnicodeTest-1346930060 None] Create snapshot completed successfully Feb 27 02:09:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] Acquiring lock "cinder-9f473483-6671-4837-827b-6a151202ba94-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] Lock "cinder-9f473483-6671-4837-827b-6a151202ba94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] Acquiring lock "cinder-quobyte-312fd3d0-e038-44b2-947f-8d6b98020850" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] Lock "cinder-quobyte-312fd3d0-e038-44b2-947f-8d6b98020850" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] Acquiring lock "cinder-quobyte-9f473483-6671-4837-827b-6a151202ba94" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] Lock "cinder-quobyte-9f473483-6671-4837-827b-6a151202ba94" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:43 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] Deleting offline snapshot 9f473483-6671-4837-827b-6a151202ba94 of volume 312fd3d0-e038-44b2-947f-8d6b98020850 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:09:43 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] snapshot_file for this snap is: volume-312fd3d0-e038-44b2-947f-8d6b98020850.9f473483-6671-4837-827b-6a151202ba94 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:09:43 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae85f5b-d9d5-4d42-a886-443b544c2c6b]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.9f473483-6671-4837-827b-6a151202ba94 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:43 devstack sudo[88909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.9f473483-6671-4837-827b-6a151202ba94 Feb 27 02:09:43 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:44 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.9f473483-6671-4837-827b-6a151202ba94" returned: 0 in 0.637s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:44 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-312fd3d0-e038-44b2-947f-8d6b98020850(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:44 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48d299c-d19f-433d-80a5-df3a86869ccb]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:44 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850 Feb 27 02:09:44 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:45 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850" returned: 0 in 0.560s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.9f473483-6671-4837-827b-6a151202ba94 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:45 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.9f473483-6671-4837-827b-6a151202ba94 Feb 27 02:09:45 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:45 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.9f473483-6671-4837-827b-6a151202ba94" returned: 0 in 0.603s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.9f473483-6671-4837-827b-6a151202ba94 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:45 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.9f473483-6671-4837-827b-6a151202ba94 Feb 27 02:09:45 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:46 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850.9f473483-6671-4837-827b-6a151202ba94" returned: 0 in 0.580s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] Lock "cinder-quobyte-9f473483-6671-4837-827b-6a151202ba94" released by "_delete_snapshot" :: held 2.461s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] Lock "cinder-quobyte-312fd3d0-e038-44b2-947f-8d6b98020850" released by "delete_snapshot" :: held 2.478s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:46 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] Created reservations ['471bb890-ddff-4666-9b63-a7ce46872403', '86056940-654f-43b4-8fa2-f9cee0f70e1d', '246025b7-ff0a-4469-810e-735a2b151c82', 'e96d3154-6b5d-4960-b6bd-b6645ce61516'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:46 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] Delete snapshot completed successfully. Feb 27 02:09:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e0664c89-8f3e-494a-a828-fc645a2ff33f tempest-CinderUnicodeTest-1346930060 None] Lock "cinder-9f473483-6671-4837-827b-6a151202ba94-delete_snapshot" released by "delete_snapshot" :: held 2.613s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-95d41877-47e1-448c-b609-f1d6d1ea0c1a tempest-CinderUnicodeTest-1346930060 None] Acquiring lock "cinder-312fd3d0-e038-44b2-947f-8d6b98020850-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-95d41877-47e1-448c-b609-f1d6d1ea0c1a tempest-CinderUnicodeTest-1346930060 None] Lock "cinder-312fd3d0-e038-44b2-947f-8d6b98020850-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-95d41877-47e1-448c-b609-f1d6d1ea0c1a tempest-CinderUnicodeTest-1346930060 None] Acquiring lock "cinder-quobyte-312fd3d0-e038-44b2-947f-8d6b98020850" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-95d41877-47e1-448c-b609-f1d6d1ea0c1a tempest-CinderUnicodeTest-1346930060 None] Lock "cinder-quobyte-312fd3d0-e038-44b2-947f-8d6b98020850" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:47 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dba0707-b07f-428d-b0f7-f5f07f69f0ed]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-95d41877-47e1-448c-b609-f1d6d1ea0c1a tempest-CinderUnicodeTest-1346930060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:47 devstack sudo[88927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850 Feb 27 02:09:47 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:47 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-95d41877-47e1-448c-b609-f1d6d1ea0c1a tempest-CinderUnicodeTest-1346930060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850" returned: 0 in 0.633s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-95d41877-47e1-448c-b609-f1d6d1ea0c1a tempest-CinderUnicodeTest-1346930060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:47 devstack sudo[88932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850 Feb 27 02:09:47 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:48 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-95d41877-47e1-448c-b609-f1d6d1ea0c1a tempest-CinderUnicodeTest-1346930060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-312fd3d0-e038-44b2-947f-8d6b98020850" returned: 0 in 0.498s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:48 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-95d41877-47e1-448c-b609-f1d6d1ea0c1a tempest-CinderUnicodeTest-1346930060 None] Lock "cinder-quobyte-312fd3d0-e038-44b2-947f-8d6b98020850" released by "delete_volume" :: held 1.176s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:48 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-95d41877-47e1-448c-b609-f1d6d1ea0c1a tempest-CinderUnicodeTest-1346930060 None] Created reservations ['55670db1-bf71-467c-b84d-a0d8736bb371', 'f4c89f1f-e0df-42ce-93b3-a53741aec862', 'f69f2c23-a590-444a-a0f9-d130c679417e', '5b04d7dc-c5f5-4a93-b273-882a96939a86'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-95d41877-47e1-448c-b609-f1d6d1ea0c1a tempest-CinderUnicodeTest-1346930060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-95d41877-47e1-448c-b609-f1d6d1ea0c1a tempest-CinderUnicodeTest-1346930060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:48 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-95d41877-47e1-448c-b609-f1d6d1ea0c1a tempest-CinderUnicodeTest-1346930060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:48 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-95d41877-47e1-448c-b609-f1d6d1ea0c1a tempest-CinderUnicodeTest-1346930060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-95d41877-47e1-448c-b609-f1d6d1ea0c1a tempest-CinderUnicodeTest-1346930060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-95d41877-47e1-448c-b609-f1d6d1ea0c1a tempest-CinderUnicodeTest-1346930060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:48 devstack sudo[88935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:09:48 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:48 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-95d41877-47e1-448c-b609-f1d6d1ea0c1a tempest-CinderUnicodeTest-1346930060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.512s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:48 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-95d41877-47e1-448c-b609-f1d6d1ea0c1a tempest-CinderUnicodeTest-1346930060 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:48 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-95d41877-47e1-448c-b609-f1d6d1ea0c1a tempest-CinderUnicodeTest-1346930060 None] Deleted volume successfully. Feb 27 02:09:48 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-95d41877-47e1-448c-b609-f1d6d1ea0c1a tempest-CinderUnicodeTest-1346930060 None] Lock "cinder-312fd3d0-e038-44b2-947f-8d6b98020850-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9990d974-313d-4275-a42b-05f8b082705f tempest-CinderUnicodeTest-1346930060 None] Acquiring lock "cinder-a225ca9a-fa86-4d88-9868-358d11492f0a-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9990d974-313d-4275-a42b-05f8b082705f tempest-CinderUnicodeTest-1346930060 None] Lock "cinder-a225ca9a-fa86-4d88-9868-358d11492f0a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9990d974-313d-4275-a42b-05f8b082705f tempest-CinderUnicodeTest-1346930060 None] Acquiring lock "cinder-quobyte-a225ca9a-fa86-4d88-9868-358d11492f0a" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:49 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9990d974-313d-4275-a42b-05f8b082705f tempest-CinderUnicodeTest-1346930060 None] Lock "cinder-quobyte-a225ca9a-fa86-4d88-9868-358d11492f0a" acquired by "delete_volume" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:49 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e4deba-1f29-41d0-af77-76cbc0a588d4]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9990d974-313d-4275-a42b-05f8b082705f tempest-CinderUnicodeTest-1346930060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a225ca9a-fa86-4d88-9868-358d11492f0a {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:49 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a225ca9a-fa86-4d88-9868-358d11492f0a Feb 27 02:09:49 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:49 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9990d974-313d-4275-a42b-05f8b082705f tempest-CinderUnicodeTest-1346930060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a225ca9a-fa86-4d88-9868-358d11492f0a" returned: 0 in 0.625s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9990d974-313d-4275-a42b-05f8b082705f tempest-CinderUnicodeTest-1346930060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a225ca9a-fa86-4d88-9868-358d11492f0a {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:49 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a225ca9a-fa86-4d88-9868-358d11492f0a Feb 27 02:09:49 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:50 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9990d974-313d-4275-a42b-05f8b082705f tempest-CinderUnicodeTest-1346930060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a225ca9a-fa86-4d88-9868-358d11492f0a" returned: 0 in 0.603s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:50 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9990d974-313d-4275-a42b-05f8b082705f tempest-CinderUnicodeTest-1346930060 None] Lock "cinder-quobyte-a225ca9a-fa86-4d88-9868-358d11492f0a" released by "delete_volume" :: held 1.265s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:50 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-9990d974-313d-4275-a42b-05f8b082705f tempest-CinderUnicodeTest-1346930060 None] Created reservations ['4e327947-5c02-499e-9672-abe107b027d2', 'c3b702f7-cf9f-44ce-8c1c-26083adad137', '6e0922ff-6644-4300-bec6-b7cf40fa2505', 'c3ef9f14-2fb5-4f96-948d-b9405e1bf211'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9990d974-313d-4275-a42b-05f8b082705f tempest-CinderUnicodeTest-1346930060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9990d974-313d-4275-a42b-05f8b082705f tempest-CinderUnicodeTest-1346930060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:50 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9990d974-313d-4275-a42b-05f8b082705f tempest-CinderUnicodeTest-1346930060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:50 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9990d974-313d-4275-a42b-05f8b082705f tempest-CinderUnicodeTest-1346930060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9990d974-313d-4275-a42b-05f8b082705f tempest-CinderUnicodeTest-1346930060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9990d974-313d-4275-a42b-05f8b082705f tempest-CinderUnicodeTest-1346930060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:50 devstack sudo[88947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:09:50 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:51 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9990d974-313d-4275-a42b-05f8b082705f tempest-CinderUnicodeTest-1346930060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.530s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:51 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-9990d974-313d-4275-a42b-05f8b082705f tempest-CinderUnicodeTest-1346930060 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:51 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-9990d974-313d-4275-a42b-05f8b082705f tempest-CinderUnicodeTest-1346930060 None] Deleted volume successfully. Feb 27 02:09:51 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9990d974-313d-4275-a42b-05f8b082705f tempest-CinderUnicodeTest-1346930060 None] Lock "cinder-a225ca9a-fa86-4d88-9868-358d11492f0a-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Flow 'volume_create_manager' (b61dc510-6f83-45a6-ace7-aaf5d76cad5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b6ab01-6b1f-45e9-b383-94b68b955027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b6ab01-6b1f-45e9-b383-94b68b955027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1531941508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35185d2b-0160-44dd-a279-9f661b7897e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb0f603aea24cec9f3a7514dbd1d590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:53Z,use_quota=True,user_id='158d99647da940d0ad98765f8fb9232a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a635879-6ad9-4566-95e1-31301974bcc5),volume_type_id=1a635879-6ad9-4566-95e1-31301974bcc5)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90df6a9-6a95-424e-9001-1f307a1a34d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90df6a9-6a95-424e-9001-1f307a1a34d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6889bdc-ee6d-42ce-bd49-fad9c5e8ef52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6889bdc-ee6d-42ce-bd49-fad9c5e8ef52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35185d2b-0160-44dd-a279-9f661b7897e6', 'volume_name': 'volume-35185d2b-0160-44dd-a279-9f661b7897e6', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa0e49c-a735-437b-b1f0-1b67c4031162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa0e49c-a735-437b-b1f0-1b67c4031162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a35f34e-32d2-4ffa-beb5-86e30e47e506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:53 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Volume 35185d2b-0160-44dd-a279-9f661b7897e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35185d2b-0160-44dd-a279-9f661b7897e6', 'volume_size': 1} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1531941508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35185d2b-0160-44dd-a279-9f661b7897e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb0f603aea24cec9f3a7514dbd1d590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:53Z,use_quota=True,user_id='158d99647da940d0ad98765f8fb9232a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a635879-6ad9-4566-95e1-31301974bcc5),volume_type_id=1a635879-6ad9-4566-95e1-31301974bcc5)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Creating volume 35185d2b-0160-44dd-a279-9f661b7897e6 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:53 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:09:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-35185d2b-0160-44dd-a279-9f661b7897e6 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:53 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-35185d2b-0160-44dd-a279-9f661b7897e6 1073741824 Feb 27 02:09:53 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:54 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-35185d2b-0160-44dd-a279-9f661b7897e6 1073741824" returned: 0 in 0.597s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-35185d2b-0160-44dd-a279-9f661b7897e6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:54 devstack sudo[88955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-35185d2b-0160-44dd-a279-9f661b7897e6 Feb 27 02:09:54 devstack sudo[88955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:54 devstack sudo[88955]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-35185d2b-0160-44dd-a279-9f661b7897e6" returned: 0 in 0.513s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a35f34e-32d2-4ffa-beb5-86e30e47e506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35185d2b-0160-44dd-a279-9f661b7897e6', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc4b463-d2f6-475d-ab8f-7ba0ce9c00fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:54 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:DELETE=14,cinder:SELECT=111,cinder:INSERT=37,cinder:UPDATE=134 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:09:54 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Volume volume-35185d2b-0160-44dd-a279-9f661b7897e6 (35185d2b-0160-44dd-a279-9f661b7897e6): created successfully Feb 27 02:09:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc4b463-d2f6-475d-ab8f-7ba0ce9c00fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Flow 'volume_create_manager' (b61dc510-6f83-45a6-ace7-aaf5d76cad5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:54 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-49ebe0d6-7892-4336-9c63-b0b31e670a3a tempest-VolumeTypesAccessTest-2134849994 None] Created volume successfully. Feb 27 02:09:55 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] Acquiring lock "cinder-35185d2b-0160-44dd-a279-9f661b7897e6-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:55 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] Lock "cinder-35185d2b-0160-44dd-a279-9f661b7897e6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:55 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] Acquiring lock "cinder-quobyte-35185d2b-0160-44dd-a279-9f661b7897e6" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:55 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] Lock "cinder-quobyte-35185d2b-0160-44dd-a279-9f661b7897e6" acquired by "delete_volume" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:55 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a7370d-07dd-482a-b08e-33e44e4d014e]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-35185d2b-0160-44dd-a279-9f661b7897e6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:55 devstack sudo[88958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-35185d2b-0160-44dd-a279-9f661b7897e6 Feb 27 02:09:55 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:56 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-35185d2b-0160-44dd-a279-9f661b7897e6" returned: 0 in 0.544s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-35185d2b-0160-44dd-a279-9f661b7897e6 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:56 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-35185d2b-0160-44dd-a279-9f661b7897e6 Feb 27 02:09:56 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:56 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-35185d2b-0160-44dd-a279-9f661b7897e6" returned: 0 in 0.507s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:56 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] Lock "cinder-quobyte-35185d2b-0160-44dd-a279-9f661b7897e6" released by "delete_volume" :: held 1.079s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:56 devstack cinder-volume[82738]: WARNING cinder.quota [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-63877499 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-63877499, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:09:56 devstack cinder-volume[82738]: WARNING cinder.quota [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-63877499 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-63877499, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:09:56 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] Created reservations ['f36326bb-efe0-4d83-acd7-aaf32a3fef4f', 'b29de844-eecb-4494-97eb-0b73c48bb55c', 'e475054d-2bad-485e-b4de-0b9ff3987828', '0083f761-dbe9-4831-ae27-1282278952cf'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:56 devstack sudo[88966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:09:56 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:57 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.535s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:57 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:57 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] Deleted volume successfully. Feb 27 02:09:57 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d6bbec8e-a33e-49c2-9d94-f3d3c59c20cb tempest-VolumeTypesAccessTest-2134849994 None] Lock "cinder-35185d2b-0160-44dd-a279-9f661b7897e6-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:11 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=9 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:10:11 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=89,cinder:INSERT=36,cinder:UPDATE=133,cinder:DELETE=9 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Flow 'volume_create_manager' (9028a14f-e5aa-4d04-bf80-58d86720b423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7daebb97-504b-41e3-a359-b9ba1b1d8c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7daebb97-504b-41e3-a359-b9ba1b1d8c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1709003029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7360771d-eee6-4d49-ba99-c0185a91ccf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c739b6ac9443618060f3072d8f8236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:13Z,use_quota=True,user_id='108a750ed4f54c849c2489acb13b70b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b644199e-1b69-49b8-b744-97d9aed2f0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b644199e-1b69-49b8-b744-97d9aed2f0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c14a823-779f-4249-ab8e-dd068c59a5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c14a823-779f-4249-ab8e-dd068c59a5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7360771d-eee6-4d49-ba99-c0185a91ccf4', 'volume_name': 'volume-7360771d-eee6-4d49-ba99-c0185a91ccf4', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd49a1ce-bfa2-4698-b25a-8fb3cececeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd49a1ce-bfa2-4698-b25a-8fb3cececeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69aee756-8888-442e-a50d-33b838b764d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Volume 7360771d-eee6-4d49-ba99-c0185a91ccf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7360771d-eee6-4d49-ba99-c0185a91ccf4', 'volume_size': 1} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1709003029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7360771d-eee6-4d49-ba99-c0185a91ccf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c739b6ac9443618060f3072d8f8236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:13Z,use_quota=True,user_id='108a750ed4f54c849c2489acb13b70b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Creating volume 7360771d-eee6-4d49-ba99-c0185a91ccf4 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:12 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:10:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:13 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 1073741824 Feb 27 02:10:13 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:13 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 1073741824" returned: 0 in 0.705s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:13 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 Feb 27 02:10:13 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:14 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4" returned: 0 in 0.474s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:14 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69aee756-8888-442e-a50d-33b838b764d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7360771d-eee6-4d49-ba99-c0185a91ccf4', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f30fef-0e1e-4e30-a52a-394ea7e831fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:14 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Volume volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 (7360771d-eee6-4d49-ba99-c0185a91ccf4): created successfully Feb 27 02:10:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f30fef-0e1e-4e30-a52a-394ea7e831fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Flow 'volume_create_manager' (9028a14f-e5aa-4d04-bf80-58d86720b423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:14 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-de154b54-c41c-41af-bcf2-637171f99750 tempest-SnapshotDependencyTests-1293425908 None] Created volume successfully. Feb 27 02:10:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5b4e6ead-4eb9-4772-a70d-b43b38b517d2 tempest-SnapshotDependencyTests-1293425908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5b4e6ead-4eb9-4772-a70d-b43b38b517d2 tempest-SnapshotDependencyTests-1293425908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-5b4e6ead-4eb9-4772-a70d-b43b38b517d2 tempest-SnapshotDependencyTests-1293425908 None] Creating offline snapshot 64311a2f-fa32-4d97-891f-9bced8f4251c of volume 7360771d-eee6-4d49-ba99-c0185a91ccf4 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:10:15 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[124b98fd-cfad-42c5-b11b-7495f545a807]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b4e6ead-4eb9-4772-a70d-b43b38b517d2 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:15 devstack sudo[88983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 Feb 27 02:10:15 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:15 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b4e6ead-4eb9-4772-a70d-b43b38b517d2 tempest-SnapshotDependencyTests-1293425908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4" returned: 0 in 0.598s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b4e6ead-4eb9-4772-a70d-b43b38b517d2 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:15 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c 1G Feb 27 02:10:15 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:16 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b4e6ead-4eb9-4772-a70d-b43b38b517d2 tempest-SnapshotDependencyTests-1293425908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c 1G" returned: 0 in 0.576s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b4e6ead-4eb9-4772-a70d-b43b38b517d2 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:16 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c Feb 27 02:10:16 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:17 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b4e6ead-4eb9-4772-a70d-b43b38b517d2 tempest-SnapshotDependencyTests-1293425908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c" returned: 0 in 0.587s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:17 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-5b4e6ead-4eb9-4772-a70d-b43b38b517d2 tempest-SnapshotDependencyTests-1293425908 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c is being set with open permissions: ugo+rw Feb 27 02:10:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b4e6ead-4eb9-4772-a70d-b43b38b517d2 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:17 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c Feb 27 02:10:17 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:17 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b4e6ead-4eb9-4772-a70d-b43b38b517d2 tempest-SnapshotDependencyTests-1293425908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c" returned: 0 in 0.475s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b4e6ead-4eb9-4772-a70d-b43b38b517d2 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:17 devstack sudo[89007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.info Feb 27 02:10:17 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:17 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b4e6ead-4eb9-4772-a70d-b43b38b517d2 tempest-SnapshotDependencyTests-1293425908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.info" returned: 0 in 0.484s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:17 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-5b4e6ead-4eb9-4772-a70d-b43b38b517d2 tempest-SnapshotDependencyTests-1293425908 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.info is being set with open permissions: ugo+rw Feb 27 02:10:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b4e6ead-4eb9-4772-a70d-b43b38b517d2 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:18 devstack sudo[89010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.info Feb 27 02:10:18 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:18 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5b4e6ead-4eb9-4772-a70d-b43b38b517d2 tempest-SnapshotDependencyTests-1293425908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.info" returned: 0 in 0.474s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5b4e6ead-4eb9-4772-a70d-b43b38b517d2 tempest-SnapshotDependencyTests-1293425908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.264s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:18 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-5b4e6ead-4eb9-4772-a70d-b43b38b517d2 tempest-SnapshotDependencyTests-1293425908 None] Create snapshot completed successfully Feb 27 02:10:19 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:19 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Flow 'volume_create_manager' (16e8a6fb-3d3e-4bca-a395-7da02d582ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:19 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361b3096-ebe1-40cf-b6cd-0168f10c76a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:19 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361b3096-ebe1-40cf-b6cd-0168f10c76a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ebecc5-a144-4422-863c-bf82ca84ec1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c739b6ac9443618060f3072d8f8236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=64311a2f-fa32-4d97-891f-9bced8f4251c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:20Z,use_quota=True,user_id='108a750ed4f54c849c2489acb13b70b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:19 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca2e598-1734-45eb-a989-485b456acf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:19 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca2e598-1734-45eb-a989-485b456acf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:19 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b346871a-ae12-4b89-8c0c-39aad11448e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:19 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b346871a-ae12-4b89-8c0c-39aad11448e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e1ebecc5-a144-4422-863c-bf82ca84ec1b', 'volume_name': 'volume-e1ebecc5-a144-4422-863c-bf82ca84ec1b', 'volume_size': 1, 'snapshot_id': '64311a2f-fa32-4d97-891f-9bced8f4251c'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:19 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4e191e-47e0-4b21-91b7-971697859031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:19 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4e191e-47e0-4b21-91b7-971697859031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:19 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4e1701-039b-4f10-bfec-75b063b233a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:19 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Volume e1ebecc5-a144-4422-863c-bf82ca84ec1b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e1ebecc5-a144-4422-863c-bf82ca84ec1b', 'volume_size': 1, 'snapshot_id': '64311a2f-fa32-4d97-891f-9bced8f4251c'} Feb 27 02:10:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:19 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Acquiring lock "cinder-quobyte-64311a2f-fa32-4d97-891f-9bced8f4251c-e1ebecc5-a144-4422-863c-bf82ca84ec1b" by "_create_volume_from_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:19 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Lock "cinder-quobyte-64311a2f-fa32-4d97-891f-9bced8f4251c-e1ebecc5-a144-4422-863c-bf82ca84ec1b" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Creating volume e1ebecc5-a144-4422-863c-bf82ca84ec1b from snapshot 64311a2f-fa32-4d97-891f-9bced8f4251c {{(pid=82738) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Acquiring lock "cinder-quobyte-e1ebecc5-a144-4422-863c-bf82ca84ec1b" by "_copy_volume_from_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Lock "cinder-quobyte-e1ebecc5-a144-4422-863c-bf82ca84ec1b" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] snapshot: 64311a2f-fa32-4d97-891f-9bced8f4251c, volume: e1ebecc5-a144-4422-863c-bf82ca84ec1b, {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[22895c06-fdff-40c2-bc0d-e7a50da72bcb]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:20 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c Feb 27 02:10:20 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:20 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c" returned: 0 in 0.655s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7360771d-eee6-4d49-ba99-c0185a91ccf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Creating direct copy from snapshot {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef50e9a-af64-4ba9-98b6-46319cf7e1c5]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:20 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 Feb 27 02:10:20 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:21 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4" returned: 0 in 0.575s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:21 devstack cinder-volume[82738]: DEBUG cinder.utils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Path /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e1ebecc5-a144-4422-863c-bf82ca84ec1b not found in is_blk_device check {{(pid=82738) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:10:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e1ebecc5-a144-4422-863c-bf82ca84ec1b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:21 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e1ebecc5-a144-4422-863c-bf82ca84ec1b Feb 27 02:10:21 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:23 devstack cinder-volume[82738]: DEBUG oslo_service.periodic_task [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82738) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:10:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:23 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:10:23 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:23 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e1ebecc5-a144-4422-863c-bf82ca84ec1b" returned: 0 in 2.456s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:23 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e31c53-5cf6-4e56-bd45-13016996e8f2]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:23 devstack sudo[89076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 Feb 27 02:10:23 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:24 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.466s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:24 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:24 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4" returned: 0 in 0.705s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:24 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4, size 1024.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e1ebecc5-a144-4422-863c-bf82ca84ec1b {{(pid=82738) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:10:24 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Converted 1024.00 MB image at 416.74 MB/s Feb 27 02:10:24 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e1ebecc5-a144-4422-863c-bf82ca84ec1b is being set with open permissions: ugo+rw Feb 27 02:10:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e1ebecc5-a144-4422-863c-bf82ca84ec1b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:24 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e1ebecc5-a144-4422-863c-bf82ca84ec1b Feb 27 02:10:24 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:25 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e1ebecc5-a144-4422-863c-bf82ca84ec1b" returned: 0 in 0.535s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Lock "cinder-quobyte-e1ebecc5-a144-4422-863c-bf82ca84ec1b" released by "_copy_volume_from_snapshot" :: held 4.994s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Lock "cinder-quobyte-64311a2f-fa32-4d97-891f-9bced8f4251c-e1ebecc5-a144-4422-863c-bf82ca84ec1b" released by "_create_volume_from_snapshot" :: held 5.014s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.027s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:25 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4e1701-039b-4f10-bfec-75b063b233a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1ebecc5-a144-4422-863c-bf82ca84ec1b', 'volume_size': 1, 'snapshot_id': '64311a2f-fa32-4d97-891f-9bced8f4251c'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:25 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80c5e53-246e-43e6-b0ee-32ef863cfde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:25 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Volume volume-e1ebecc5-a144-4422-863c-bf82ca84ec1b (e1ebecc5-a144-4422-863c-bf82ca84ec1b): created successfully Feb 27 02:10:25 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80c5e53-246e-43e6-b0ee-32ef863cfde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:25 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Flow 'volume_create_manager' (16e8a6fb-3d3e-4bca-a395-7da02d582ba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:25 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-d85a1c2b-d4fb-40a3-a2e9-b46d9c2bed22 tempest-SnapshotDependencyTests-1293425908 None] Created volume successfully. Feb 27 02:10:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] Acquiring lock "cinder-64311a2f-fa32-4d97-891f-9bced8f4251c-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] Lock "cinder-64311a2f-fa32-4d97-891f-9bced8f4251c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] Acquiring lock "cinder-quobyte-7360771d-eee6-4d49-ba99-c0185a91ccf4" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] Lock "cinder-quobyte-7360771d-eee6-4d49-ba99-c0185a91ccf4" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] Acquiring lock "cinder-quobyte-64311a2f-fa32-4d97-891f-9bced8f4251c" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] Lock "cinder-quobyte-64311a2f-fa32-4d97-891f-9bced8f4251c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:25 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] Deleting offline snapshot 64311a2f-fa32-4d97-891f-9bced8f4251c of volume 7360771d-eee6-4d49-ba99-c0185a91ccf4 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:10:25 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] snapshot_file for this snap is: volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:10:25 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[830edc70-22a7-4feb-aa5f-607dd6131d48]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:25 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c Feb 27 02:10:25 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:26 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c" returned: 0 in 0.584s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7360771d-eee6-4d49-ba99-c0185a91ccf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:10:26 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cefee42-f4d0-4fd4-bf78-f1e1e51371da]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:26 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 Feb 27 02:10:26 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:26 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4" returned: 0 in 0.554s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:26 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c Feb 27 02:10:26 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:27 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c" returned: 0 in 0.552s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:27 devstack sudo[89100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c Feb 27 02:10:27 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:27 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4.64311a2f-fa32-4d97-891f-9bced8f4251c" returned: 0 in 0.472s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:27 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] Lock "cinder-quobyte-64311a2f-fa32-4d97-891f-9bced8f4251c" released by "_delete_snapshot" :: held 2.225s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:27 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] Lock "cinder-quobyte-7360771d-eee6-4d49-ba99-c0185a91ccf4" released by "delete_snapshot" :: held 2.244s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:27 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] Created reservations ['99372e33-3aa8-4a79-a672-71b331ebb428', 'a23f23fd-4300-4433-a503-a75fae75dfb0', '39434bef-4309-436e-97ef-22136d215200', 'b1f0de03-2c39-4a62-b560-45b7588b9e2b'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:27 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] Delete snapshot completed successfully. Feb 27 02:10:27 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a794d36e-92ac-49c3-9ed3-d38b1af5a803 tempest-SnapshotDependencyTests-1293425908 None] Lock "cinder-64311a2f-fa32-4d97-891f-9bced8f4251c-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:28 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7932f156-5b54-4457-9672-1d3137777673 tempest-SnapshotDependencyTests-1293425908 None] Acquiring lock "cinder-7360771d-eee6-4d49-ba99-c0185a91ccf4-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:28 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7932f156-5b54-4457-9672-1d3137777673 tempest-SnapshotDependencyTests-1293425908 None] Lock "cinder-7360771d-eee6-4d49-ba99-c0185a91ccf4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:28 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7932f156-5b54-4457-9672-1d3137777673 tempest-SnapshotDependencyTests-1293425908 None] Acquiring lock "cinder-quobyte-7360771d-eee6-4d49-ba99-c0185a91ccf4" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:28 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7932f156-5b54-4457-9672-1d3137777673 tempest-SnapshotDependencyTests-1293425908 None] Lock "cinder-quobyte-7360771d-eee6-4d49-ba99-c0185a91ccf4" acquired by "delete_volume" :: waited 0.026s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:28 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4607b1-09b8-4bd7-ad69-76e8def35419]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7932f156-5b54-4457-9672-1d3137777673 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:28 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 Feb 27 02:10:28 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:29 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7932f156-5b54-4457-9672-1d3137777673 tempest-SnapshotDependencyTests-1293425908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4" returned: 0 in 0.735s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7932f156-5b54-4457-9672-1d3137777673 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:29 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4 Feb 27 02:10:29 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:30 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7932f156-5b54-4457-9672-1d3137777673 tempest-SnapshotDependencyTests-1293425908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7360771d-eee6-4d49-ba99-c0185a91ccf4" returned: 0 in 0.587s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:30 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7932f156-5b54-4457-9672-1d3137777673 tempest-SnapshotDependencyTests-1293425908 None] Lock "cinder-quobyte-7360771d-eee6-4d49-ba99-c0185a91ccf4" released by "delete_volume" :: held 1.373s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:30 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-7932f156-5b54-4457-9672-1d3137777673 tempest-SnapshotDependencyTests-1293425908 None] Created reservations ['a860bbea-8b45-4d6f-810e-7a69d81428a9', 'cc798f7c-146a-4271-a68a-af876a130037', '709252e7-85af-46f6-ba80-091027860ce6', '69f9594f-2573-4f92-91ac-4a7ebab42f42'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7932f156-5b54-4457-9672-1d3137777673 tempest-SnapshotDependencyTests-1293425908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7932f156-5b54-4457-9672-1d3137777673 tempest-SnapshotDependencyTests-1293425908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:30 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7932f156-5b54-4457-9672-1d3137777673 tempest-SnapshotDependencyTests-1293425908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:30 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7932f156-5b54-4457-9672-1d3137777673 tempest-SnapshotDependencyTests-1293425908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7932f156-5b54-4457-9672-1d3137777673 tempest-SnapshotDependencyTests-1293425908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7932f156-5b54-4457-9672-1d3137777673 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:30 devstack sudo[89117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:10:30 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:30 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7932f156-5b54-4457-9672-1d3137777673 tempest-SnapshotDependencyTests-1293425908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.560s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:30 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-7932f156-5b54-4457-9672-1d3137777673 tempest-SnapshotDependencyTests-1293425908 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:30 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-7932f156-5b54-4457-9672-1d3137777673 tempest-SnapshotDependencyTests-1293425908 None] Deleted volume successfully. Feb 27 02:10:30 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7932f156-5b54-4457-9672-1d3137777673 tempest-SnapshotDependencyTests-1293425908 None] Lock "cinder-7360771d-eee6-4d49-ba99-c0185a91ccf4-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:31 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0ed4553e-d361-4a16-8699-75e277f4d297 tempest-SnapshotDependencyTests-1293425908 None] Acquiring lock "cinder-e1ebecc5-a144-4422-863c-bf82ca84ec1b-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:31 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0ed4553e-d361-4a16-8699-75e277f4d297 tempest-SnapshotDependencyTests-1293425908 None] Lock "cinder-e1ebecc5-a144-4422-863c-bf82ca84ec1b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:31 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0ed4553e-d361-4a16-8699-75e277f4d297 tempest-SnapshotDependencyTests-1293425908 None] Acquiring lock "cinder-quobyte-e1ebecc5-a144-4422-863c-bf82ca84ec1b" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:31 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0ed4553e-d361-4a16-8699-75e277f4d297 tempest-SnapshotDependencyTests-1293425908 None] Lock "cinder-quobyte-e1ebecc5-a144-4422-863c-bf82ca84ec1b" acquired by "delete_volume" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:31 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bb984e-eec7-4c98-a585-7701761d7df5]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0ed4553e-d361-4a16-8699-75e277f4d297 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e1ebecc5-a144-4422-863c-bf82ca84ec1b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:31 devstack sudo[89132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e1ebecc5-a144-4422-863c-bf82ca84ec1b Feb 27 02:10:31 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:31 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0ed4553e-d361-4a16-8699-75e277f4d297 tempest-SnapshotDependencyTests-1293425908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e1ebecc5-a144-4422-863c-bf82ca84ec1b" returned: 0 in 0.570s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0ed4553e-d361-4a16-8699-75e277f4d297 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e1ebecc5-a144-4422-863c-bf82ca84ec1b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:31 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e1ebecc5-a144-4422-863c-bf82ca84ec1b Feb 27 02:10:31 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:32 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0ed4553e-d361-4a16-8699-75e277f4d297 tempest-SnapshotDependencyTests-1293425908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e1ebecc5-a144-4422-863c-bf82ca84ec1b" returned: 0 in 0.606s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:32 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0ed4553e-d361-4a16-8699-75e277f4d297 tempest-SnapshotDependencyTests-1293425908 None] Lock "cinder-quobyte-e1ebecc5-a144-4422-863c-bf82ca84ec1b" released by "delete_volume" :: held 1.203s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:32 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-0ed4553e-d361-4a16-8699-75e277f4d297 tempest-SnapshotDependencyTests-1293425908 None] Created reservations ['1ca805e2-6d8b-40af-b89c-1c6a4318fc88', 'd50b443c-cb81-440c-bc6f-ff579fb8b79b', '5544f96b-b505-4628-bcff-c6bd870cc5b9', 'd3d292a9-920b-414a-ac1a-fe972f15228f'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0ed4553e-d361-4a16-8699-75e277f4d297 tempest-SnapshotDependencyTests-1293425908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0ed4553e-d361-4a16-8699-75e277f4d297 tempest-SnapshotDependencyTests-1293425908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:32 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0ed4553e-d361-4a16-8699-75e277f4d297 tempest-SnapshotDependencyTests-1293425908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:32 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0ed4553e-d361-4a16-8699-75e277f4d297 tempest-SnapshotDependencyTests-1293425908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0ed4553e-d361-4a16-8699-75e277f4d297 tempest-SnapshotDependencyTests-1293425908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0ed4553e-d361-4a16-8699-75e277f4d297 tempest-SnapshotDependencyTests-1293425908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:32 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:10:32 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:32 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0ed4553e-d361-4a16-8699-75e277f4d297 tempest-SnapshotDependencyTests-1293425908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.484s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:32 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-0ed4553e-d361-4a16-8699-75e277f4d297 tempest-SnapshotDependencyTests-1293425908 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:32 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-0ed4553e-d361-4a16-8699-75e277f4d297 tempest-SnapshotDependencyTests-1293425908 None] Deleted volume successfully. Feb 27 02:10:32 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0ed4553e-d361-4a16-8699-75e277f4d297 tempest-SnapshotDependencyTests-1293425908 None] Lock "cinder-e1ebecc5-a144-4422-863c-bf82ca84ec1b-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Flow 'volume_create_manager' (1872cab7-372c-4134-b620-cd612322bb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46082e3f-eb11-4ba0-a3cc-1b746ee94ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46082e3f-eb11-4ba0-a3cc-1b746ee94ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1183060496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea8c6f9-bfdb-4029-8773-70432cd74976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f1d126c2b7430d927886894bd549da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:41Z,use_quota=True,user_id='eeebff8252964ea18dcef894c096db8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fa42d0-d3db-44ac-8746-a200f4ed90fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fa42d0-d3db-44ac-8746-a200f4ed90fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce7936b-88d9-4566-9bcb-fced54467656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce7936b-88d9-4566-9bcb-fced54467656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ea8c6f9-bfdb-4029-8773-70432cd74976', 'volume_name': 'volume-2ea8c6f9-bfdb-4029-8773-70432cd74976', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949029a4-74c4-4122-9a09-dd7f67f6d6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949029a4-74c4-4122-9a09-dd7f67f6d6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ba248e-523f-41f1-8183-e25b039760e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:41 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Volume 2ea8c6f9-bfdb-4029-8773-70432cd74976: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ea8c6f9-bfdb-4029-8773-70432cd74976', 'volume_size': 1} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1183060496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea8c6f9-bfdb-4029-8773-70432cd74976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f1d126c2b7430d927886894bd549da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:41Z,use_quota=True,user_id='eeebff8252964ea18dcef894c096db8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Creating volume 2ea8c6f9-bfdb-4029-8773-70432cd74976 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:41 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:10:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2ea8c6f9-bfdb-4029-8773-70432cd74976 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:41 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2ea8c6f9-bfdb-4029-8773-70432cd74976 1073741824 Feb 27 02:10:41 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:42 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2ea8c6f9-bfdb-4029-8773-70432cd74976 1073741824" returned: 0 in 0.696s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2ea8c6f9-bfdb-4029-8773-70432cd74976 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:42 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2ea8c6f9-bfdb-4029-8773-70432cd74976 Feb 27 02:10:42 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:42 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2ea8c6f9-bfdb-4029-8773-70432cd74976" returned: 0 in 0.523s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:42 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:42 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ba248e-523f-41f1-8183-e25b039760e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ea8c6f9-bfdb-4029-8773-70432cd74976', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:42 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea425b4-56ed-49f6-95ed-0e7d468668f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:42 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Volume volume-2ea8c6f9-bfdb-4029-8773-70432cd74976 (2ea8c6f9-bfdb-4029-8773-70432cd74976): created successfully Feb 27 02:10:42 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea425b4-56ed-49f6-95ed-0e7d468668f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:42 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Flow 'volume_create_manager' (1872cab7-372c-4134-b620-cd612322bb11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:42 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-9c864e7a-541f-49b3-b43c-3f843ea9e70d tempest-VolumesActionsTest-627968509 None] Created volume successfully. Feb 27 02:10:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-6cc51db4-aa64-4fe6-a37c-2d8e09e21f99 tempest-VolumesActionsTest-627968509 None] Acquiring lock "cinder-2ea8c6f9-bfdb-4029-8773-70432cd74976" by "attach_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-6cc51db4-aa64-4fe6-a37c-2d8e09e21f99 tempest-VolumesActionsTest-627968509 None] Lock "cinder-2ea8c6f9-bfdb-4029-8773-70432cd74976" acquired by "attach_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:43 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-6cc51db4-aa64-4fe6-a37c-2d8e09e21f99 tempest-VolumesActionsTest-627968509 None] Attaching volume 2ea8c6f9-bfdb-4029-8773-70432cd74976 to instance 94fd850a-8901-4301-8044-5a209224bcfe at mountpoint /dev/vdb on host None. Feb 27 02:10:43 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-6cc51db4-aa64-4fe6-a37c-2d8e09e21f99 tempest-VolumesActionsTest-627968509 None] Attach volume completed successfully. Feb 27 02:10:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-6cc51db4-aa64-4fe6-a37c-2d8e09e21f99 tempest-VolumesActionsTest-627968509 None] Lock "cinder-2ea8c6f9-bfdb-4029-8773-70432cd74976" released by "attach_volume" :: held 0.086s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:44 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-60dea73f-78b4-4667-bd4a-18f9cefed7b5 tempest-VolumesActionsTest-1647675243 None] Terminate volume connection completed successfully. Feb 27 02:10:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-60dea73f-78b4-4667-bd4a-18f9cefed7b5 tempest-VolumesActionsTest-1647675243 None] Acquiring lock "cinder-2ea8c6f9-bfdb-4029-8773-70432cd74976-detach_volume" by "detach_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-60dea73f-78b4-4667-bd4a-18f9cefed7b5 tempest-VolumesActionsTest-1647675243 None] Lock "cinder-2ea8c6f9-bfdb-4029-8773-70432cd74976-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:45 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-60dea73f-78b4-4667-bd4a-18f9cefed7b5 tempest-VolumesActionsTest-1647675243 None] Detaching volume 2ea8c6f9-bfdb-4029-8773-70432cd74976 from instance 94fd850a-8901-4301-8044-5a209224bcfe. Feb 27 02:10:45 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-60dea73f-78b4-4667-bd4a-18f9cefed7b5 tempest-VolumesActionsTest-1647675243 None] Detach volume completed successfully. Feb 27 02:10:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-60dea73f-78b4-4667-bd4a-18f9cefed7b5 tempest-VolumesActionsTest-1647675243 None] Lock "cinder-2ea8c6f9-bfdb-4029-8773-70432cd74976-detach_volume" released by "detach_volume" :: held 0.058s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-19953872-69ff-418a-bb12-f30981359e8a tempest-VolumesActionsTest-627968509 None] Acquiring lock "cinder-2ea8c6f9-bfdb-4029-8773-70432cd74976-detach_volume" by "detach_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-19953872-69ff-418a-bb12-f30981359e8a tempest-VolumesActionsTest-627968509 None] Lock "cinder-2ea8c6f9-bfdb-4029-8773-70432cd74976-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:45 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-19953872-69ff-418a-bb12-f30981359e8a tempest-VolumesActionsTest-627968509 None] Volume detach called, but volume not attached. Feb 27 02:10:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-19953872-69ff-418a-bb12-f30981359e8a tempest-VolumesActionsTest-627968509 None] Lock "cinder-2ea8c6f9-bfdb-4029-8773-70432cd74976-detach_volume" released by "detach_volume" :: held 0.012s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1eec2c14-10e1-4217-ad0d-6f23b04221d3 tempest-VolumesActionsTest-627968509 None] Acquiring lock "cinder-2ea8c6f9-bfdb-4029-8773-70432cd74976-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1eec2c14-10e1-4217-ad0d-6f23b04221d3 tempest-VolumesActionsTest-627968509 None] Lock "cinder-2ea8c6f9-bfdb-4029-8773-70432cd74976-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1eec2c14-10e1-4217-ad0d-6f23b04221d3 tempest-VolumesActionsTest-627968509 None] Acquiring lock "cinder-quobyte-2ea8c6f9-bfdb-4029-8773-70432cd74976" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1eec2c14-10e1-4217-ad0d-6f23b04221d3 tempest-VolumesActionsTest-627968509 None] Lock "cinder-quobyte-2ea8c6f9-bfdb-4029-8773-70432cd74976" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:46 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a440cd-00e6-436d-bf2a-243fa73e4613]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1eec2c14-10e1-4217-ad0d-6f23b04221d3 tempest-VolumesActionsTest-627968509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2ea8c6f9-bfdb-4029-8773-70432cd74976 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:46 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2ea8c6f9-bfdb-4029-8773-70432cd74976 Feb 27 02:10:46 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:46 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1eec2c14-10e1-4217-ad0d-6f23b04221d3 tempest-VolumesActionsTest-627968509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2ea8c6f9-bfdb-4029-8773-70432cd74976" returned: 0 in 0.509s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1eec2c14-10e1-4217-ad0d-6f23b04221d3 tempest-VolumesActionsTest-627968509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2ea8c6f9-bfdb-4029-8773-70432cd74976 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:47 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2ea8c6f9-bfdb-4029-8773-70432cd74976 Feb 27 02:10:47 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:47 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1eec2c14-10e1-4217-ad0d-6f23b04221d3 tempest-VolumesActionsTest-627968509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2ea8c6f9-bfdb-4029-8773-70432cd74976" returned: 0 in 0.441s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1eec2c14-10e1-4217-ad0d-6f23b04221d3 tempest-VolumesActionsTest-627968509 None] Lock "cinder-quobyte-2ea8c6f9-bfdb-4029-8773-70432cd74976" released by "delete_volume" :: held 0.999s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:47 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-1eec2c14-10e1-4217-ad0d-6f23b04221d3 tempest-VolumesActionsTest-627968509 None] Created reservations ['652cec92-3f94-41e8-810d-3fe75490e3b1', 'e2a7a4d7-2574-437b-b59b-87b04bc8960a', '7c9ad2b2-587e-4b68-9be2-4978b30e51c7', 'e3ed9814-6119-4f3b-9454-b8e06f5e142d'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1eec2c14-10e1-4217-ad0d-6f23b04221d3 tempest-VolumesActionsTest-627968509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1eec2c14-10e1-4217-ad0d-6f23b04221d3 tempest-VolumesActionsTest-627968509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1eec2c14-10e1-4217-ad0d-6f23b04221d3 tempest-VolumesActionsTest-627968509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1eec2c14-10e1-4217-ad0d-6f23b04221d3 tempest-VolumesActionsTest-627968509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1eec2c14-10e1-4217-ad0d-6f23b04221d3 tempest-VolumesActionsTest-627968509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1eec2c14-10e1-4217-ad0d-6f23b04221d3 tempest-VolumesActionsTest-627968509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:47 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:10:47 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:48 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1eec2c14-10e1-4217-ad0d-6f23b04221d3 tempest-VolumesActionsTest-627968509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.442s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:48 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-1eec2c14-10e1-4217-ad0d-6f23b04221d3 tempest-VolumesActionsTest-627968509 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:48 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-1eec2c14-10e1-4217-ad0d-6f23b04221d3 tempest-VolumesActionsTest-627968509 None] Deleted volume successfully. Feb 27 02:10:48 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1eec2c14-10e1-4217-ad0d-6f23b04221d3 tempest-VolumesActionsTest-627968509 None] Lock "cinder-2ea8c6f9-bfdb-4029-8773-70432cd74976-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Flow 'volume_create_manager' (fea59b38-3205-4903-acec-91d8c19ecbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7e08c7-432f-4756-be24-2cc3145f6019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7e08c7-432f-4756-be24-2cc3145f6019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1822269625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e82c47e7-a572-42cd-86d9-a8739bae5420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f1d126c2b7430d927886894bd549da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:56Z,use_quota=True,user_id='eeebff8252964ea18dcef894c096db8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329df47b-30fb-4b30-87b6-ecb0b5c1c0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329df47b-30fb-4b30-87b6-ecb0b5c1c0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39468ac4-e859-4c69-8154-0857897c2fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39468ac4-e859-4c69-8154-0857897c2fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e82c47e7-a572-42cd-86d9-a8739bae5420', 'volume_name': 'volume-e82c47e7-a572-42cd-86d9-a8739bae5420', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35741f5c-1f98-44e7-b85d-77af3318ebab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35741f5c-1f98-44e7-b85d-77af3318ebab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9e40a4-6e5b-4d18-b0ba-1c370421e083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:56 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Volume e82c47e7-a572-42cd-86d9-a8739bae5420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e82c47e7-a572-42cd-86d9-a8739bae5420', 'volume_size': 1} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1822269625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e82c47e7-a572-42cd-86d9-a8739bae5420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f1d126c2b7430d927886894bd549da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:56Z,use_quota=True,user_id='eeebff8252964ea18dcef894c096db8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Creating volume e82c47e7-a572-42cd-86d9-a8739bae5420 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:56 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e82c47e7-a572-42cd-86d9-a8739bae5420 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:56 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e82c47e7-a572-42cd-86d9-a8739bae5420 1073741824 Feb 27 02:10:56 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:56 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e82c47e7-a572-42cd-86d9-a8739bae5420 1073741824" returned: 0 in 0.496s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e82c47e7-a572-42cd-86d9-a8739bae5420 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:56 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e82c47e7-a572-42cd-86d9-a8739bae5420 Feb 27 02:10:56 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:57 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e82c47e7-a572-42cd-86d9-a8739bae5420" returned: 0 in 0.405s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:57 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9e40a4-6e5b-4d18-b0ba-1c370421e083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e82c47e7-a572-42cd-86d9-a8739bae5420', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a4154b-6fa3-4e36-8cd1-3460627de86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:57 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Volume volume-e82c47e7-a572-42cd-86d9-a8739bae5420 (e82c47e7-a572-42cd-86d9-a8739bae5420): created successfully Feb 27 02:10:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a4154b-6fa3-4e36-8cd1-3460627de86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Flow 'volume_create_manager' (fea59b38-3205-4903-acec-91d8c19ecbd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:57 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-d13551c7-e3da-4ba7-9f3a-213048838923 tempest-VolumesActionsTest-627968509 None] Created volume successfully. Feb 27 02:10:58 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7c5f8a48-c20c-4828-9d6b-34ff5e607e10 tempest-VolumesActionsTest-1647675243 None] Acquiring lock "cinder-e82c47e7-a572-42cd-86d9-a8739bae5420-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:58 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7c5f8a48-c20c-4828-9d6b-34ff5e607e10 tempest-VolumesActionsTest-1647675243 None] Lock "cinder-e82c47e7-a572-42cd-86d9-a8739bae5420-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:58 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7c5f8a48-c20c-4828-9d6b-34ff5e607e10 tempest-VolumesActionsTest-1647675243 None] Acquiring lock "cinder-quobyte-e82c47e7-a572-42cd-86d9-a8739bae5420" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:58 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7c5f8a48-c20c-4828-9d6b-34ff5e607e10 tempest-VolumesActionsTest-1647675243 None] Lock "cinder-quobyte-e82c47e7-a572-42cd-86d9-a8739bae5420" acquired by "delete_volume" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:58 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1d1efc-3bb3-4199-bf4f-00d467efbf81]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7c5f8a48-c20c-4828-9d6b-34ff5e607e10 tempest-VolumesActionsTest-1647675243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e82c47e7-a572-42cd-86d9-a8739bae5420 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:58 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e82c47e7-a572-42cd-86d9-a8739bae5420 Feb 27 02:10:58 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:58 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7c5f8a48-c20c-4828-9d6b-34ff5e607e10 tempest-VolumesActionsTest-1647675243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e82c47e7-a572-42cd-86d9-a8739bae5420" returned: 0 in 0.503s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7c5f8a48-c20c-4828-9d6b-34ff5e607e10 tempest-VolumesActionsTest-1647675243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e82c47e7-a572-42cd-86d9-a8739bae5420 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:59 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e82c47e7-a572-42cd-86d9-a8739bae5420 Feb 27 02:10:59 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:59 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7c5f8a48-c20c-4828-9d6b-34ff5e607e10 tempest-VolumesActionsTest-1647675243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e82c47e7-a572-42cd-86d9-a8739bae5420" returned: 0 in 0.471s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:59 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7c5f8a48-c20c-4828-9d6b-34ff5e607e10 tempest-VolumesActionsTest-1647675243 None] Lock "cinder-quobyte-e82c47e7-a572-42cd-86d9-a8739bae5420" released by "delete_volume" :: held 1.008s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:59 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-7c5f8a48-c20c-4828-9d6b-34ff5e607e10 tempest-VolumesActionsTest-1647675243 None] Created reservations ['4638b717-f122-4473-a57e-c54a730854b5', '0531688f-dc6f-47f0-8cc3-9f3133d1a45d', '5bced274-e713-4fb2-9e05-0fc4fbfb287a', 'ed1f1dbb-8001-440e-b77b-ce803afcd2e8'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7c5f8a48-c20c-4828-9d6b-34ff5e607e10 tempest-VolumesActionsTest-1647675243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7c5f8a48-c20c-4828-9d6b-34ff5e607e10 tempest-VolumesActionsTest-1647675243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7c5f8a48-c20c-4828-9d6b-34ff5e607e10 tempest-VolumesActionsTest-1647675243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7c5f8a48-c20c-4828-9d6b-34ff5e607e10 tempest-VolumesActionsTest-1647675243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7c5f8a48-c20c-4828-9d6b-34ff5e607e10 tempest-VolumesActionsTest-1647675243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7c5f8a48-c20c-4828-9d6b-34ff5e607e10 tempest-VolumesActionsTest-1647675243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:59 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:10:59 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:00 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7c5f8a48-c20c-4828-9d6b-34ff5e607e10 tempest-VolumesActionsTest-1647675243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.459s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-7c5f8a48-c20c-4828-9d6b-34ff5e607e10 tempest-VolumesActionsTest-1647675243 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:00 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-7c5f8a48-c20c-4828-9d6b-34ff5e607e10 tempest-VolumesActionsTest-1647675243 None] Deleted volume successfully. Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7c5f8a48-c20c-4828-9d6b-34ff5e607e10 tempest-VolumesActionsTest-1647675243 None] Lock "cinder-e82c47e7-a572-42cd-86d9-a8739bae5420-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Flow 'volume_create_manager' (7c2d0c9e-7df8-4337-9f4a-61615c9e5e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (978821c8-e50b-4242-a2e8-58eaa6a97aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (978821c8-e50b-4242-a2e8-58eaa6a97aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1555552512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84db35f0-88fb-46aa-9ab8-2211e587d3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f1d126c2b7430d927886894bd549da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:01Z,use_quota=True,user_id='eeebff8252964ea18dcef894c096db8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d30af49-ccaf-489f-bf7d-97a1b1411eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d30af49-ccaf-489f-bf7d-97a1b1411eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb616397-b03b-4a29-99c0-6396c1c43a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb616397-b03b-4a29-99c0-6396c1c43a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84db35f0-88fb-46aa-9ab8-2211e587d3a2', 'volume_name': 'volume-84db35f0-88fb-46aa-9ab8-2211e587d3a2', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7663aa0-f304-4d59-a26c-a7712725d21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7663aa0-f304-4d59-a26c-a7712725d21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d62d14d-8076-4d62-bee1-39d4f1ecc572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:00 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Volume 84db35f0-88fb-46aa-9ab8-2211e587d3a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84db35f0-88fb-46aa-9ab8-2211e587d3a2', 'volume_size': 1} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1555552512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84db35f0-88fb-46aa-9ab8-2211e587d3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f1d126c2b7430d927886894bd549da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:01Z,use_quota=True,user_id='eeebff8252964ea18dcef894c096db8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Creating volume 84db35f0-88fb-46aa-9ab8-2211e587d3a2 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:00 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:11:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-84db35f0-88fb-46aa-9ab8-2211e587d3a2 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:00 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-84db35f0-88fb-46aa-9ab8-2211e587d3a2 1073741824 Feb 27 02:11:00 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:01 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-84db35f0-88fb-46aa-9ab8-2211e587d3a2 1073741824" returned: 0 in 0.471s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-84db35f0-88fb-46aa-9ab8-2211e587d3a2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:01 devstack sudo[89255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-84db35f0-88fb-46aa-9ab8-2211e587d3a2 Feb 27 02:11:01 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:01 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-84db35f0-88fb-46aa-9ab8-2211e587d3a2" returned: 0 in 0.412s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d62d14d-8076-4d62-bee1-39d4f1ecc572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84db35f0-88fb-46aa-9ab8-2211e587d3a2', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e12045-68ea-46dc-a5ae-fc2feb331d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:01 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Volume volume-84db35f0-88fb-46aa-9ab8-2211e587d3a2 (84db35f0-88fb-46aa-9ab8-2211e587d3a2): created successfully Feb 27 02:11:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e12045-68ea-46dc-a5ae-fc2feb331d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Flow 'volume_create_manager' (7c2d0c9e-7df8-4337-9f4a-61615c9e5e10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:01 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-f2d23555-8a02-4869-bb69-34978bcc75f8 tempest-VolumesActionsTest-627968509 None] Created volume successfully. Feb 27 02:11:03 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5947d724-9ab7-4fa5-9d3a-8682af9d8141 tempest-VolumesActionsTest-1647675243 None] Acquiring lock "cinder-84db35f0-88fb-46aa-9ab8-2211e587d3a2-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:03 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5947d724-9ab7-4fa5-9d3a-8682af9d8141 tempest-VolumesActionsTest-1647675243 None] Lock "cinder-84db35f0-88fb-46aa-9ab8-2211e587d3a2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:03 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5947d724-9ab7-4fa5-9d3a-8682af9d8141 tempest-VolumesActionsTest-1647675243 None] Acquiring lock "cinder-quobyte-84db35f0-88fb-46aa-9ab8-2211e587d3a2" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:03 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5947d724-9ab7-4fa5-9d3a-8682af9d8141 tempest-VolumesActionsTest-1647675243 None] Lock "cinder-quobyte-84db35f0-88fb-46aa-9ab8-2211e587d3a2" acquired by "delete_volume" :: waited 0.007s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:03 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbab5ae-a9b8-41c4-b401-66d750f1e887]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5947d724-9ab7-4fa5-9d3a-8682af9d8141 tempest-VolumesActionsTest-1647675243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-84db35f0-88fb-46aa-9ab8-2211e587d3a2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:03 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-84db35f0-88fb-46aa-9ab8-2211e587d3a2 Feb 27 02:11:03 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:03 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5947d724-9ab7-4fa5-9d3a-8682af9d8141 tempest-VolumesActionsTest-1647675243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-84db35f0-88fb-46aa-9ab8-2211e587d3a2" returned: 0 in 0.506s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5947d724-9ab7-4fa5-9d3a-8682af9d8141 tempest-VolumesActionsTest-1647675243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-84db35f0-88fb-46aa-9ab8-2211e587d3a2 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:03 devstack sudo[89263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-84db35f0-88fb-46aa-9ab8-2211e587d3a2 Feb 27 02:11:03 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:04 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5947d724-9ab7-4fa5-9d3a-8682af9d8141 tempest-VolumesActionsTest-1647675243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-84db35f0-88fb-46aa-9ab8-2211e587d3a2" returned: 0 in 0.420s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5947d724-9ab7-4fa5-9d3a-8682af9d8141 tempest-VolumesActionsTest-1647675243 None] Lock "cinder-quobyte-84db35f0-88fb-46aa-9ab8-2211e587d3a2" released by "delete_volume" :: held 0.953s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-5947d724-9ab7-4fa5-9d3a-8682af9d8141 tempest-VolumesActionsTest-1647675243 None] Created reservations ['01eb14dd-7c7e-41e1-911d-8b70c1190f5d', '6289cff3-1045-4e95-8fca-042f6610b87f', 'f41944be-4133-49a0-bd12-50758d982ef1', 'a0e15f9b-3011-4e6f-824e-853c0720113d'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5947d724-9ab7-4fa5-9d3a-8682af9d8141 tempest-VolumesActionsTest-1647675243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5947d724-9ab7-4fa5-9d3a-8682af9d8141 tempest-VolumesActionsTest-1647675243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5947d724-9ab7-4fa5-9d3a-8682af9d8141 tempest-VolumesActionsTest-1647675243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5947d724-9ab7-4fa5-9d3a-8682af9d8141 tempest-VolumesActionsTest-1647675243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5947d724-9ab7-4fa5-9d3a-8682af9d8141 tempest-VolumesActionsTest-1647675243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5947d724-9ab7-4fa5-9d3a-8682af9d8141 tempest-VolumesActionsTest-1647675243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:04 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:11:04 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Flow 'volume_create_manager' (4709bcfe-57e8-4d57-a588-f37667e45f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c63dfe-5110-416a-b425-7487920cef86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c63dfe-5110-416a-b425-7487920cef86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-784491470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a4d6a5-1940-465b-98ec-d95a2515d4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f1d126c2b7430d927886894bd549da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:05Z,use_quota=True,user_id='eeebff8252964ea18dcef894c096db8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe375b9-63af-41ba-be58-53c907e0e513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe375b9-63af-41ba-be58-53c907e0e513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c6aade-575a-4a1d-8a58-fcb17f5cf4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c6aade-575a-4a1d-8a58-fcb17f5cf4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7a4d6a5-1940-465b-98ec-d95a2515d4a4', 'volume_name': 'volume-c7a4d6a5-1940-465b-98ec-d95a2515d4a4', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077d13bc-6d51-4ffc-a8d5-d909497d1765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077d13bc-6d51-4ffc-a8d5-d909497d1765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f84ffad-b424-4a9c-9f14-9bc990b9bbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:04 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Volume c7a4d6a5-1940-465b-98ec-d95a2515d4a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7a4d6a5-1940-465b-98ec-d95a2515d4a4', 'volume_size': 1} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-784491470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a4d6a5-1940-465b-98ec-d95a2515d4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f1d126c2b7430d927886894bd549da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:05Z,use_quota=True,user_id='eeebff8252964ea18dcef894c096db8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Creating volume c7a4d6a5-1940-465b-98ec-d95a2515d4a4 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:04 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c7a4d6a5-1940-465b-98ec-d95a2515d4a4 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:04 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c7a4d6a5-1940-465b-98ec-d95a2515d4a4 1073741824 Feb 27 02:11:04 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:04 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5947d724-9ab7-4fa5-9d3a-8682af9d8141 tempest-VolumesActionsTest-1647675243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.550s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-5947d724-9ab7-4fa5-9d3a-8682af9d8141 tempest-VolumesActionsTest-1647675243 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:04 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-5947d724-9ab7-4fa5-9d3a-8682af9d8141 tempest-VolumesActionsTest-1647675243 None] Deleted volume successfully. Feb 27 02:11:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-5947d724-9ab7-4fa5-9d3a-8682af9d8141 tempest-VolumesActionsTest-1647675243 None] Lock "cinder-84db35f0-88fb-46aa-9ab8-2211e587d3a2-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:05 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c7a4d6a5-1940-465b-98ec-d95a2515d4a4 1073741824" returned: 0 in 0.601s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c7a4d6a5-1940-465b-98ec-d95a2515d4a4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:05 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c7a4d6a5-1940-465b-98ec-d95a2515d4a4 Feb 27 02:11:05 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:05 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c7a4d6a5-1940-465b-98ec-d95a2515d4a4" returned: 0 in 0.554s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:05 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f84ffad-b424-4a9c-9f14-9bc990b9bbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7a4d6a5-1940-465b-98ec-d95a2515d4a4', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9791b18-24d1-486e-a92c-25cae282eead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:05 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Volume volume-c7a4d6a5-1940-465b-98ec-d95a2515d4a4 (c7a4d6a5-1940-465b-98ec-d95a2515d4a4): created successfully Feb 27 02:11:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9791b18-24d1-486e-a92c-25cae282eead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Flow 'volume_create_manager' (4709bcfe-57e8-4d57-a588-f37667e45f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:05 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-bef942ba-a789-471d-b751-d29dd5c43f01 tempest-VolumesActionsTest-627968509 None] Created volume successfully. Feb 27 02:11:06 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7bc5848c-69a5-4231-913f-b1533d75e127 tempest-VolumesActionsTest-1647675243 None] Acquiring lock "cinder-c7a4d6a5-1940-465b-98ec-d95a2515d4a4-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:06 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7bc5848c-69a5-4231-913f-b1533d75e127 tempest-VolumesActionsTest-1647675243 None] Lock "cinder-c7a4d6a5-1940-465b-98ec-d95a2515d4a4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:06 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7bc5848c-69a5-4231-913f-b1533d75e127 tempest-VolumesActionsTest-1647675243 None] Acquiring lock "cinder-quobyte-c7a4d6a5-1940-465b-98ec-d95a2515d4a4" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:06 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7bc5848c-69a5-4231-913f-b1533d75e127 tempest-VolumesActionsTest-1647675243 None] Lock "cinder-quobyte-c7a4d6a5-1940-465b-98ec-d95a2515d4a4" acquired by "delete_volume" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:06 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9143ee6-d756-43b9-9084-b8eab8343b53]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7bc5848c-69a5-4231-913f-b1533d75e127 tempest-VolumesActionsTest-1647675243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c7a4d6a5-1940-465b-98ec-d95a2515d4a4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:07 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c7a4d6a5-1940-465b-98ec-d95a2515d4a4 Feb 27 02:11:07 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:07 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7bc5848c-69a5-4231-913f-b1533d75e127 tempest-VolumesActionsTest-1647675243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c7a4d6a5-1940-465b-98ec-d95a2515d4a4" returned: 0 in 0.563s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7bc5848c-69a5-4231-913f-b1533d75e127 tempest-VolumesActionsTest-1647675243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c7a4d6a5-1940-465b-98ec-d95a2515d4a4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:07 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c7a4d6a5-1940-465b-98ec-d95a2515d4a4 Feb 27 02:11:07 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:07 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7bc5848c-69a5-4231-913f-b1533d75e127 tempest-VolumesActionsTest-1647675243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c7a4d6a5-1940-465b-98ec-d95a2515d4a4" returned: 0 in 0.465s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:07 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7bc5848c-69a5-4231-913f-b1533d75e127 tempest-VolumesActionsTest-1647675243 None] Lock "cinder-quobyte-c7a4d6a5-1940-465b-98ec-d95a2515d4a4" released by "delete_volume" :: held 1.055s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:08 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-7bc5848c-69a5-4231-913f-b1533d75e127 tempest-VolumesActionsTest-1647675243 None] Created reservations ['04653689-3e43-4f3e-b17f-18a8866afbea', 'c3cfafc8-f457-45a3-9035-2d2d28b480ab', '1e0cdbf4-aae1-45d7-9593-3cb21b0569e8', '8624566a-d396-4c29-a70c-6065805d2248'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7bc5848c-69a5-4231-913f-b1533d75e127 tempest-VolumesActionsTest-1647675243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7bc5848c-69a5-4231-913f-b1533d75e127 tempest-VolumesActionsTest-1647675243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7bc5848c-69a5-4231-913f-b1533d75e127 tempest-VolumesActionsTest-1647675243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7bc5848c-69a5-4231-913f-b1533d75e127 tempest-VolumesActionsTest-1647675243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7bc5848c-69a5-4231-913f-b1533d75e127 tempest-VolumesActionsTest-1647675243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7bc5848c-69a5-4231-913f-b1533d75e127 tempest-VolumesActionsTest-1647675243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:08 devstack sudo[89285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:11:08 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:08 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7bc5848c-69a5-4231-913f-b1533d75e127 tempest-VolumesActionsTest-1647675243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.415s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:08 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-7bc5848c-69a5-4231-913f-b1533d75e127 tempest-VolumesActionsTest-1647675243 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:08 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-7bc5848c-69a5-4231-913f-b1533d75e127 tempest-VolumesActionsTest-1647675243 None] Deleted volume successfully. Feb 27 02:11:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-7bc5848c-69a5-4231-913f-b1533d75e127 tempest-VolumesActionsTest-1647675243 None] Lock "cinder-c7a4d6a5-1940-465b-98ec-d95a2515d4a4-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Flow 'volume_create_manager' (73e1ae2a-48c4-44b7-8da1-2e26e35eb89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70961ee1-72ae-4658-ae4c-d68ce3fc6d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70961ee1-72ae-4658-ae4c-d68ce3fc6d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1084935385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad83947f-bee3-4d59-9d1f-58a2d2d1f302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f1d126c2b7430d927886894bd549da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:09Z,use_quota=True,user_id='eeebff8252964ea18dcef894c096db8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21efd55b-a34d-4e81-a1b9-708a2a826aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21efd55b-a34d-4e81-a1b9-708a2a826aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ae38d9-c411-4870-90dc-db9a5ad351c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ae38d9-c411-4870-90dc-db9a5ad351c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad83947f-bee3-4d59-9d1f-58a2d2d1f302', 'volume_name': 'volume-ad83947f-bee3-4d59-9d1f-58a2d2d1f302', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ee27eb-25ee-40cd-887f-c75dc7c52f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ee27eb-25ee-40cd-887f-c75dc7c52f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242d85d5-cd1d-4b80-80b5-bf679c0ebc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:09 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Volume ad83947f-bee3-4d59-9d1f-58a2d2d1f302: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad83947f-bee3-4d59-9d1f-58a2d2d1f302', 'volume_size': 1} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1084935385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad83947f-bee3-4d59-9d1f-58a2d2d1f302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f1d126c2b7430d927886894bd549da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:09Z,use_quota=True,user_id='eeebff8252964ea18dcef894c096db8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Creating volume ad83947f-bee3-4d59-9d1f-58a2d2d1f302 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:09 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad83947f-bee3-4d59-9d1f-58a2d2d1f302 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:09 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad83947f-bee3-4d59-9d1f-58a2d2d1f302 1073741824 Feb 27 02:11:09 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:09 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad83947f-bee3-4d59-9d1f-58a2d2d1f302 1073741824" returned: 0 in 0.495s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad83947f-bee3-4d59-9d1f-58a2d2d1f302 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:09 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad83947f-bee3-4d59-9d1f-58a2d2d1f302 Feb 27 02:11:09 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:10 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad83947f-bee3-4d59-9d1f-58a2d2d1f302" returned: 0 in 0.424s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242d85d5-cd1d-4b80-80b5-bf679c0ebc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad83947f-bee3-4d59-9d1f-58a2d2d1f302', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294ad64e-225e-486b-bd58-8ce71919d63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:10 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Volume volume-ad83947f-bee3-4d59-9d1f-58a2d2d1f302 (ad83947f-bee3-4d59-9d1f-58a2d2d1f302): created successfully Feb 27 02:11:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294ad64e-225e-486b-bd58-8ce71919d63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Flow 'volume_create_manager' (73e1ae2a-48c4-44b7-8da1-2e26e35eb89a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:10 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-ee43eab1-fa31-403f-af5d-ba1512d51734 tempest-VolumesActionsTest-627968509 None] Created volume successfully. Feb 27 02:11:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-06a5707e-24ee-404a-91db-51d7f91847bd tempest-VolumesActionsTest-1647675243 None] Acquiring lock "cinder-ad83947f-bee3-4d59-9d1f-58a2d2d1f302-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-06a5707e-24ee-404a-91db-51d7f91847bd tempest-VolumesActionsTest-1647675243 None] Lock "cinder-ad83947f-bee3-4d59-9d1f-58a2d2d1f302-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-06a5707e-24ee-404a-91db-51d7f91847bd tempest-VolumesActionsTest-1647675243 None] Acquiring lock "cinder-quobyte-ad83947f-bee3-4d59-9d1f-58a2d2d1f302" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-06a5707e-24ee-404a-91db-51d7f91847bd tempest-VolumesActionsTest-1647675243 None] Lock "cinder-quobyte-ad83947f-bee3-4d59-9d1f-58a2d2d1f302" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:11 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23c6cfd-79a9-4a82-8e23-27c6d6ebe3b5]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-06a5707e-24ee-404a-91db-51d7f91847bd tempest-VolumesActionsTest-1647675243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad83947f-bee3-4d59-9d1f-58a2d2d1f302 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:11 devstack sudo[89299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad83947f-bee3-4d59-9d1f-58a2d2d1f302 Feb 27 02:11:11 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:12 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-06a5707e-24ee-404a-91db-51d7f91847bd tempest-VolumesActionsTest-1647675243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad83947f-bee3-4d59-9d1f-58a2d2d1f302" returned: 0 in 0.501s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-06a5707e-24ee-404a-91db-51d7f91847bd tempest-VolumesActionsTest-1647675243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad83947f-bee3-4d59-9d1f-58a2d2d1f302 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:12 devstack sudo[89304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad83947f-bee3-4d59-9d1f-58a2d2d1f302 Feb 27 02:11:12 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:12 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-06a5707e-24ee-404a-91db-51d7f91847bd tempest-VolumesActionsTest-1647675243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ad83947f-bee3-4d59-9d1f-58a2d2d1f302" returned: 0 in 0.436s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:12 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-06a5707e-24ee-404a-91db-51d7f91847bd tempest-VolumesActionsTest-1647675243 None] Lock "cinder-quobyte-ad83947f-bee3-4d59-9d1f-58a2d2d1f302" released by "delete_volume" :: held 0.961s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:12 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=64,cinder:UPDATE=90,cinder:DELETE=9,cinder:INSERT=17 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:11:12 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=62,cinder:INSERT=20,cinder:UPDATE=68,cinder:DELETE=5 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:11:12 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-06a5707e-24ee-404a-91db-51d7f91847bd tempest-VolumesActionsTest-1647675243 None] Created reservations ['8fb1db7c-ed0f-4070-b75f-031205a6a257', '15c44e97-e092-42bd-bf9b-4a61cc6e7606', '29708014-dceb-4121-ba3e-49132dc42e74', '0b7011c0-3322-4587-bffc-5281ae5831cc'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-06a5707e-24ee-404a-91db-51d7f91847bd tempest-VolumesActionsTest-1647675243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-06a5707e-24ee-404a-91db-51d7f91847bd tempest-VolumesActionsTest-1647675243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-06a5707e-24ee-404a-91db-51d7f91847bd tempest-VolumesActionsTest-1647675243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-06a5707e-24ee-404a-91db-51d7f91847bd tempest-VolumesActionsTest-1647675243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-06a5707e-24ee-404a-91db-51d7f91847bd tempest-VolumesActionsTest-1647675243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-06a5707e-24ee-404a-91db-51d7f91847bd tempest-VolumesActionsTest-1647675243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:12 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:11:12 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Flow 'volume_create_manager' (dac04995-37a0-4c5b-a5b5-1e1ac7b9f545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f6bfbd-ebb6-452d-a0cf-f5f568762342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f6bfbd-ebb6-452d-a0cf-f5f568762342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1566879000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba775df4-ef20-4148-9aa1-871404bc0b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f1d126c2b7430d927886894bd549da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:13Z,use_quota=True,user_id='eeebff8252964ea18dcef894c096db8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67229ca6-2558-4db1-9d32-5d3c124e1a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67229ca6-2558-4db1-9d32-5d3c124e1a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1edfc1-1874-4e60-8ed5-4ca27c649f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1edfc1-1874-4e60-8ed5-4ca27c649f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba775df4-ef20-4148-9aa1-871404bc0b49', 'volume_name': 'volume-ba775df4-ef20-4148-9aa1-871404bc0b49', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e650ccc9-1502-4af9-b8bb-f1677cf5bb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e650ccc9-1502-4af9-b8bb-f1677cf5bb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0bc912-ebb1-4ffe-a329-69608ba09f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:13 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Volume ba775df4-ef20-4148-9aa1-871404bc0b49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba775df4-ef20-4148-9aa1-871404bc0b49', 'volume_size': 1} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1566879000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba775df4-ef20-4148-9aa1-871404bc0b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f1d126c2b7430d927886894bd549da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:13Z,use_quota=True,user_id='eeebff8252964ea18dcef894c096db8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Creating volume ba775df4-ef20-4148-9aa1-871404bc0b49 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:13 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba775df4-ef20-4148-9aa1-871404bc0b49 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:13 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-06a5707e-24ee-404a-91db-51d7f91847bd tempest-VolumesActionsTest-1647675243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.455s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-06a5707e-24ee-404a-91db-51d7f91847bd tempest-VolumesActionsTest-1647675243 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:13 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba775df4-ef20-4148-9aa1-871404bc0b49 1073741824 Feb 27 02:11:13 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:13 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-06a5707e-24ee-404a-91db-51d7f91847bd tempest-VolumesActionsTest-1647675243 None] Deleted volume successfully. Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-06a5707e-24ee-404a-91db-51d7f91847bd tempest-VolumesActionsTest-1647675243 None] Lock "cinder-ad83947f-bee3-4d59-9d1f-58a2d2d1f302-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:13 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba775df4-ef20-4148-9aa1-871404bc0b49 1073741824" returned: 0 in 0.554s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba775df4-ef20-4148-9aa1-871404bc0b49 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:13 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba775df4-ef20-4148-9aa1-871404bc0b49 Feb 27 02:11:13 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:14 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba775df4-ef20-4148-9aa1-871404bc0b49" returned: 0 in 0.432s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:14 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0bc912-ebb1-4ffe-a329-69608ba09f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba775df4-ef20-4148-9aa1-871404bc0b49', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b977a873-468e-439c-917d-2bae286559ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:14 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Volume volume-ba775df4-ef20-4148-9aa1-871404bc0b49 (ba775df4-ef20-4148-9aa1-871404bc0b49): created successfully Feb 27 02:11:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b977a873-468e-439c-917d-2bae286559ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Flow 'volume_create_manager' (dac04995-37a0-4c5b-a5b5-1e1ac7b9f545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:14 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-3238a6d9-45d9-4304-9385-fdf90f35338e tempest-VolumesActionsTest-627968509 None] Created volume successfully. Feb 27 02:11:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b46c39aa-9668-4b76-8ed1-a906ff9e38ec tempest-VolumesActionsTest-627968509 None] Acquiring lock "cinder-ba775df4-ef20-4148-9aa1-871404bc0b49-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b46c39aa-9668-4b76-8ed1-a906ff9e38ec tempest-VolumesActionsTest-627968509 None] Lock "cinder-ba775df4-ef20-4148-9aa1-871404bc0b49-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b46c39aa-9668-4b76-8ed1-a906ff9e38ec tempest-VolumesActionsTest-627968509 None] Acquiring lock "cinder-quobyte-ba775df4-ef20-4148-9aa1-871404bc0b49" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b46c39aa-9668-4b76-8ed1-a906ff9e38ec tempest-VolumesActionsTest-627968509 None] Lock "cinder-quobyte-ba775df4-ef20-4148-9aa1-871404bc0b49" acquired by "delete_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:15 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81cff29-27a6-4885-80b7-34087d7a80e3]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b46c39aa-9668-4b76-8ed1-a906ff9e38ec tempest-VolumesActionsTest-627968509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba775df4-ef20-4148-9aa1-871404bc0b49 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:15 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba775df4-ef20-4148-9aa1-871404bc0b49 Feb 27 02:11:15 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:16 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b46c39aa-9668-4b76-8ed1-a906ff9e38ec tempest-VolumesActionsTest-627968509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba775df4-ef20-4148-9aa1-871404bc0b49" returned: 0 in 0.488s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b46c39aa-9668-4b76-8ed1-a906ff9e38ec tempest-VolumesActionsTest-627968509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba775df4-ef20-4148-9aa1-871404bc0b49 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:16 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba775df4-ef20-4148-9aa1-871404bc0b49 Feb 27 02:11:16 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:16 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b46c39aa-9668-4b76-8ed1-a906ff9e38ec tempest-VolumesActionsTest-627968509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba775df4-ef20-4148-9aa1-871404bc0b49" returned: 0 in 0.466s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:16 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b46c39aa-9668-4b76-8ed1-a906ff9e38ec tempest-VolumesActionsTest-627968509 None] Lock "cinder-quobyte-ba775df4-ef20-4148-9aa1-871404bc0b49" released by "delete_volume" :: held 0.981s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:16 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-b46c39aa-9668-4b76-8ed1-a906ff9e38ec tempest-VolumesActionsTest-627968509 None] Created reservations ['8060d82a-163b-497b-b3e0-7a58196b33a9', 'f7d1fced-0ff4-4127-85d4-d5b6e82f60f4', '6475b58d-62f6-4b16-8293-18087e763ff9', '1d4a309a-88cb-48d2-a1f3-6a829c453781'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b46c39aa-9668-4b76-8ed1-a906ff9e38ec tempest-VolumesActionsTest-627968509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b46c39aa-9668-4b76-8ed1-a906ff9e38ec tempest-VolumesActionsTest-627968509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b46c39aa-9668-4b76-8ed1-a906ff9e38ec tempest-VolumesActionsTest-627968509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b46c39aa-9668-4b76-8ed1-a906ff9e38ec tempest-VolumesActionsTest-627968509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b46c39aa-9668-4b76-8ed1-a906ff9e38ec tempest-VolumesActionsTest-627968509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b46c39aa-9668-4b76-8ed1-a906ff9e38ec tempest-VolumesActionsTest-627968509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:16 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:11:16 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:17 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b46c39aa-9668-4b76-8ed1-a906ff9e38ec tempest-VolumesActionsTest-627968509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.485s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:17 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-b46c39aa-9668-4b76-8ed1-a906ff9e38ec tempest-VolumesActionsTest-627968509 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:17 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-b46c39aa-9668-4b76-8ed1-a906ff9e38ec tempest-VolumesActionsTest-627968509 None] Deleted volume successfully. Feb 27 02:11:17 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b46c39aa-9668-4b76-8ed1-a906ff9e38ec tempest-VolumesActionsTest-627968509 None] Lock "cinder-ba775df4-ef20-4148-9aa1-871404bc0b49-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:23 devstack cinder-volume[82738]: DEBUG oslo_service.periodic_task [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82738) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:11:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:23 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:11:23 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:24 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.481s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:24 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Flow 'volume_create_manager' (09161ca6-4f26-4ac0-be96-57793e7e7c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (333b9a85-8c96-4658-9439-1159debc3725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (333b9a85-8c96-4658-9439-1159debc3725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1055709927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3084a706-8d35-4082-8d78-f7b0be2eb6aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a97de82ed4c4b62aa3b41ae6b60b000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:27Z,use_quota=True,user_id='49c0f702f04c4f8ba20de1be66baf3dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2492bb30-d065-4d96-af1d-412a39a063a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2492bb30-d065-4d96-af1d-412a39a063a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71834328-b987-40d3-bd2f-eddad2f4efbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71834328-b987-40d3-bd2f-eddad2f4efbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3084a706-8d35-4082-8d78-f7b0be2eb6aa', 'volume_name': 'volume-3084a706-8d35-4082-8d78-f7b0be2eb6aa', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3cebd0-3d77-4c1f-bf93-576989aaf982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3cebd0-3d77-4c1f-bf93-576989aaf982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67de0f6-75ca-4b53-be43-dfdd698c65fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:26 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Volume 3084a706-8d35-4082-8d78-f7b0be2eb6aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3084a706-8d35-4082-8d78-f7b0be2eb6aa', 'volume_size': 1} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1055709927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3084a706-8d35-4082-8d78-f7b0be2eb6aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a97de82ed4c4b62aa3b41ae6b60b000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:27Z,use_quota=True,user_id='49c0f702f04c4f8ba20de1be66baf3dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Creating volume 3084a706-8d35-4082-8d78-f7b0be2eb6aa {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:26 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:11:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3084a706-8d35-4082-8d78-f7b0be2eb6aa 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:26 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3084a706-8d35-4082-8d78-f7b0be2eb6aa 1073741824 Feb 27 02:11:26 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:27 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3084a706-8d35-4082-8d78-f7b0be2eb6aa 1073741824" returned: 0 in 0.501s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3084a706-8d35-4082-8d78-f7b0be2eb6aa {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:27 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3084a706-8d35-4082-8d78-f7b0be2eb6aa Feb 27 02:11:27 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:27 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3084a706-8d35-4082-8d78-f7b0be2eb6aa" returned: 0 in 0.455s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:27 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67de0f6-75ca-4b53-be43-dfdd698c65fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3084a706-8d35-4082-8d78-f7b0be2eb6aa', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee315ab-8341-400b-95ce-ad9f6d443d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:27 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Volume volume-3084a706-8d35-4082-8d78-f7b0be2eb6aa (3084a706-8d35-4082-8d78-f7b0be2eb6aa): created successfully Feb 27 02:11:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee315ab-8341-400b-95ce-ad9f6d443d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Flow 'volume_create_manager' (09161ca6-4f26-4ac0-be96-57793e7e7c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:27 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-dad9f8a5-7b37-44b4-86a2-e55210ca9245 tempest-VolumesListAdminTestJSON-1337639171 None] Created volume successfully. Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Flow 'volume_create_manager' (1d640adb-e4e7-49cf-b3ca-9d0f52dee3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6e8bf7-befd-4f48-a28f-15ccd9cb803f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6e8bf7-befd-4f48-a28f-15ccd9cb803f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1355290732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c68329-ddde-4091-b835-3d7ec8bd4691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a97de82ed4c4b62aa3b41ae6b60b000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:29Z,use_quota=True,user_id='49c0f702f04c4f8ba20de1be66baf3dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43793cd4-4ca4-4fca-9232-aa96cef96b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43793cd4-4ca4-4fca-9232-aa96cef96b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df6c338-67b7-44bf-8421-3acad594f1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df6c338-67b7-44bf-8421-3acad594f1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3c68329-ddde-4091-b835-3d7ec8bd4691', 'volume_name': 'volume-a3c68329-ddde-4091-b835-3d7ec8bd4691', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a643352-3737-40df-af38-1b7d031f267b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a643352-3737-40df-af38-1b7d031f267b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68dee3f4-a8f4-4c8b-b584-ceb7c187aef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:29 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Volume a3c68329-ddde-4091-b835-3d7ec8bd4691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3c68329-ddde-4091-b835-3d7ec8bd4691', 'volume_size': 1} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1355290732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c68329-ddde-4091-b835-3d7ec8bd4691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a97de82ed4c4b62aa3b41ae6b60b000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:29Z,use_quota=True,user_id='49c0f702f04c4f8ba20de1be66baf3dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Creating volume a3c68329-ddde-4091-b835-3d7ec8bd4691 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:29 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a3c68329-ddde-4091-b835-3d7ec8bd4691 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:29 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a3c68329-ddde-4091-b835-3d7ec8bd4691 1073741824 Feb 27 02:11:29 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:29 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a3c68329-ddde-4091-b835-3d7ec8bd4691 1073741824" returned: 0 in 0.529s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a3c68329-ddde-4091-b835-3d7ec8bd4691 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:29 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a3c68329-ddde-4091-b835-3d7ec8bd4691 Feb 27 02:11:29 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:30 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a3c68329-ddde-4091-b835-3d7ec8bd4691" returned: 0 in 0.456s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:30 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68dee3f4-a8f4-4c8b-b584-ceb7c187aef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3c68329-ddde-4091-b835-3d7ec8bd4691', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc58260e-843a-4c3d-9e6e-5e9703a040f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:30 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Volume volume-a3c68329-ddde-4091-b835-3d7ec8bd4691 (a3c68329-ddde-4091-b835-3d7ec8bd4691): created successfully Feb 27 02:11:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc58260e-843a-4c3d-9e6e-5e9703a040f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:30 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Flow 'volume_create_manager' (1d640adb-e4e7-49cf-b3ca-9d0f52dee3f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:30 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-33f896c6-49bd-4b60-a99a-16556e70c780 tempest-VolumesListAdminTestJSON-1337639171 None] Created volume successfully. Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Flow 'volume_create_manager' (9815d972-4c12-425a-aef7-6aadb5b6e878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5b45cf-d46f-4991-9278-b6e363a9579a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5b45cf-d46f-4991-9278-b6e363a9579a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1854873017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c881c0-3466-4c13-9766-7a61e72a6411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a97de82ed4c4b62aa3b41ae6b60b000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:31Z,use_quota=True,user_id='49c0f702f04c4f8ba20de1be66baf3dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf377b5-89a2-4059-bd28-4d481be1e35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf377b5-89a2-4059-bd28-4d481be1e35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afdb49e0-e901-4a76-8a9e-5b0fb7f65cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afdb49e0-e901-4a76-8a9e-5b0fb7f65cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48c881c0-3466-4c13-9766-7a61e72a6411', 'volume_name': 'volume-48c881c0-3466-4c13-9766-7a61e72a6411', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc846479-267f-44d4-8d3a-c65f0645639f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc846479-267f-44d4-8d3a-c65f0645639f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e65a99-8f22-4b0d-9c9b-9696baac179c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:31 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Volume 48c881c0-3466-4c13-9766-7a61e72a6411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48c881c0-3466-4c13-9766-7a61e72a6411', 'volume_size': 1} Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1854873017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c881c0-3466-4c13-9766-7a61e72a6411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a97de82ed4c4b62aa3b41ae6b60b000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:31Z,use_quota=True,user_id='49c0f702f04c4f8ba20de1be66baf3dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Creating volume 48c881c0-3466-4c13-9766-7a61e72a6411 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:31 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:11:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-48c881c0-3466-4c13-9766-7a61e72a6411 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:31 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-48c881c0-3466-4c13-9766-7a61e72a6411 1073741824 Feb 27 02:11:31 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:32 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-48c881c0-3466-4c13-9766-7a61e72a6411 1073741824" returned: 0 in 0.509s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-48c881c0-3466-4c13-9766-7a61e72a6411 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:32 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-48c881c0-3466-4c13-9766-7a61e72a6411 Feb 27 02:11:32 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:32 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-48c881c0-3466-4c13-9766-7a61e72a6411" returned: 0 in 0.408s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:32 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e65a99-8f22-4b0d-9c9b-9696baac179c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48c881c0-3466-4c13-9766-7a61e72a6411', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce203c0-dc9a-447a-b14b-6a9c796745f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Volume volume-48c881c0-3466-4c13-9766-7a61e72a6411 (48c881c0-3466-4c13-9766-7a61e72a6411): created successfully Feb 27 02:11:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce203c0-dc9a-447a-b14b-6a9c796745f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Flow 'volume_create_manager' (9815d972-4c12-425a-aef7-6aadb5b6e878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:32 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e72fd4b1-7ecf-4997-b2d2-6a13c9e9501e tempest-VolumesListAdminTestJSON-1337639171 None] Created volume successfully. Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Flow 'volume_create_manager' (59fd7601-7032-42e5-8d9d-1cd0488a8ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (108d039f-737c-4b29-9be0-40d900b6c7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (108d039f-737c-4b29-9be0-40d900b6c7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da57e9fc-49b9-4033-8013-f421bcf8692f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99683c9f45b408abcf7c13c1dff20ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:34Z,use_quota=True,user_id='3644ad4856cc4d15b917160793177263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d024133-c6ca-41e8-8186-585ee311f5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d024133-c6ca-41e8-8186-585ee311f5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab489d68-8d2e-4fdd-82fa-cf7ec1778616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab489d68-8d2e-4fdd-82fa-cf7ec1778616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da57e9fc-49b9-4033-8013-f421bcf8692f', 'volume_name': 'volume-da57e9fc-49b9-4033-8013-f421bcf8692f', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3435cc-b633-464e-a28c-e02d7ae6d132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3435cc-b633-464e-a28c-e02d7ae6d132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990ac041-3751-4029-a681-9b5db2fb1106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:33 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Volume da57e9fc-49b9-4033-8013-f421bcf8692f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da57e9fc-49b9-4033-8013-f421bcf8692f', 'volume_size': 1} Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da57e9fc-49b9-4033-8013-f421bcf8692f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99683c9f45b408abcf7c13c1dff20ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:34Z,use_quota=True,user_id='3644ad4856cc4d15b917160793177263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Creating volume da57e9fc-49b9-4033-8013-f421bcf8692f {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:33 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:11:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-da57e9fc-49b9-4033-8013-f421bcf8692f 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:34 devstack sudo[89404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-da57e9fc-49b9-4033-8013-f421bcf8692f 1073741824 Feb 27 02:11:34 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:34 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-da57e9fc-49b9-4033-8013-f421bcf8692f 1073741824" returned: 0 in 0.569s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-da57e9fc-49b9-4033-8013-f421bcf8692f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:34 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-da57e9fc-49b9-4033-8013-f421bcf8692f Feb 27 02:11:34 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:35 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-da57e9fc-49b9-4033-8013-f421bcf8692f" returned: 0 in 0.446s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990ac041-3751-4029-a681-9b5db2fb1106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da57e9fc-49b9-4033-8013-f421bcf8692f', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4526e7da-bcb4-44d6-bdcd-1fa284803d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:35 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Volume volume-da57e9fc-49b9-4033-8013-f421bcf8692f (da57e9fc-49b9-4033-8013-f421bcf8692f): created successfully Feb 27 02:11:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4526e7da-bcb4-44d6-bdcd-1fa284803d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Flow 'volume_create_manager' (59fd7601-7032-42e5-8d9d-1cd0488a8ed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:35 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-8755ebb9-ee0f-4bac-8934-4acd179b3af3 tempest-VolumesListAdminTestJSON-666070959 None] Created volume successfully. Feb 27 02:11:36 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ca8931e1-ff1d-4192-a697-36b06dd292c8 tempest-VolumesListAdminTestJSON-666070959 None] Acquiring lock "cinder-da57e9fc-49b9-4033-8013-f421bcf8692f-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:36 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ca8931e1-ff1d-4192-a697-36b06dd292c8 tempest-VolumesListAdminTestJSON-666070959 None] Lock "cinder-da57e9fc-49b9-4033-8013-f421bcf8692f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:36 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ca8931e1-ff1d-4192-a697-36b06dd292c8 tempest-VolumesListAdminTestJSON-666070959 None] Acquiring lock "cinder-quobyte-da57e9fc-49b9-4033-8013-f421bcf8692f" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:36 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ca8931e1-ff1d-4192-a697-36b06dd292c8 tempest-VolumesListAdminTestJSON-666070959 None] Lock "cinder-quobyte-da57e9fc-49b9-4033-8013-f421bcf8692f" acquired by "delete_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:36 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a37b65-bc1b-40fc-a951-7ee37db0a7e2]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ca8931e1-ff1d-4192-a697-36b06dd292c8 tempest-VolumesListAdminTestJSON-666070959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-da57e9fc-49b9-4033-8013-f421bcf8692f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:36 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ab7f1a13-8ecc-4a99-8f63-ea1df09786b2 tempest-VolumesListAdminTestJSON-1337639171 None] Acquiring lock "cinder-48c881c0-3466-4c13-9766-7a61e72a6411-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:36 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ab7f1a13-8ecc-4a99-8f63-ea1df09786b2 tempest-VolumesListAdminTestJSON-1337639171 None] Lock "cinder-48c881c0-3466-4c13-9766-7a61e72a6411-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:36 devstack sudo[89412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-da57e9fc-49b9-4033-8013-f421bcf8692f Feb 27 02:11:36 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:36 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ab7f1a13-8ecc-4a99-8f63-ea1df09786b2 tempest-VolumesListAdminTestJSON-1337639171 None] Acquiring lock "cinder-quobyte-48c881c0-3466-4c13-9766-7a61e72a6411" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:36 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ab7f1a13-8ecc-4a99-8f63-ea1df09786b2 tempest-VolumesListAdminTestJSON-1337639171 None] Lock "cinder-quobyte-48c881c0-3466-4c13-9766-7a61e72a6411" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:36 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44a7c3a-591f-4686-b549-28effd396be3]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ab7f1a13-8ecc-4a99-8f63-ea1df09786b2 tempest-VolumesListAdminTestJSON-1337639171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-48c881c0-3466-4c13-9766-7a61e72a6411 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:36 devstack sudo[89414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-48c881c0-3466-4c13-9766-7a61e72a6411 Feb 27 02:11:36 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:36 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ca8931e1-ff1d-4192-a697-36b06dd292c8 tempest-VolumesListAdminTestJSON-666070959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-da57e9fc-49b9-4033-8013-f421bcf8692f" returned: 0 in 0.530s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ca8931e1-ff1d-4192-a697-36b06dd292c8 tempest-VolumesListAdminTestJSON-666070959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-da57e9fc-49b9-4033-8013-f421bcf8692f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:36 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-da57e9fc-49b9-4033-8013-f421bcf8692f Feb 27 02:11:36 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:36 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ab7f1a13-8ecc-4a99-8f63-ea1df09786b2 tempest-VolumesListAdminTestJSON-1337639171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-48c881c0-3466-4c13-9766-7a61e72a6411" returned: 0 in 0.516s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ab7f1a13-8ecc-4a99-8f63-ea1df09786b2 tempest-VolumesListAdminTestJSON-1337639171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-48c881c0-3466-4c13-9766-7a61e72a6411 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:36 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-48c881c0-3466-4c13-9766-7a61e72a6411 Feb 27 02:11:36 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:37 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ca8931e1-ff1d-4192-a697-36b06dd292c8 tempest-VolumesListAdminTestJSON-666070959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-da57e9fc-49b9-4033-8013-f421bcf8692f" returned: 0 in 0.429s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ca8931e1-ff1d-4192-a697-36b06dd292c8 tempest-VolumesListAdminTestJSON-666070959 None] Lock "cinder-quobyte-da57e9fc-49b9-4033-8013-f421bcf8692f" released by "delete_volume" :: held 0.991s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-ca8931e1-ff1d-4192-a697-36b06dd292c8 tempest-VolumesListAdminTestJSON-666070959 None] Created reservations ['d8fd1f1c-d508-4c9d-bc74-f3d86e7cd755', '683bd3ac-10e2-47ee-bc17-3c2f52ef7989', '3a32febe-d9a5-47f9-a567-b28437854b61', 'a5d37c41-057d-4519-b5d7-bc6a58823752'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ca8931e1-ff1d-4192-a697-36b06dd292c8 tempest-VolumesListAdminTestJSON-666070959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ca8931e1-ff1d-4192-a697-36b06dd292c8 tempest-VolumesListAdminTestJSON-666070959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ca8931e1-ff1d-4192-a697-36b06dd292c8 tempest-VolumesListAdminTestJSON-666070959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ca8931e1-ff1d-4192-a697-36b06dd292c8 tempest-VolumesListAdminTestJSON-666070959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ca8931e1-ff1d-4192-a697-36b06dd292c8 tempest-VolumesListAdminTestJSON-666070959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ca8931e1-ff1d-4192-a697-36b06dd292c8 tempest-VolumesListAdminTestJSON-666070959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:37 devstack sudo[89428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:11:37 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:37 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ab7f1a13-8ecc-4a99-8f63-ea1df09786b2 tempest-VolumesListAdminTestJSON-1337639171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-48c881c0-3466-4c13-9766-7a61e72a6411" returned: 0 in 0.480s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ab7f1a13-8ecc-4a99-8f63-ea1df09786b2 tempest-VolumesListAdminTestJSON-1337639171 None] Lock "cinder-quobyte-48c881c0-3466-4c13-9766-7a61e72a6411" released by "delete_volume" :: held 1.024s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-ab7f1a13-8ecc-4a99-8f63-ea1df09786b2 tempest-VolumesListAdminTestJSON-1337639171 None] Created reservations ['0480160b-cbb5-4d00-9e08-3dbf6355b945', '00b6dcfe-2f83-48d7-bc5f-493007bce276', 'bce3d042-03ee-45ea-a7bc-91e51e4e64f7', '35715207-79ef-4b83-aa5d-7e753998e338'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ab7f1a13-8ecc-4a99-8f63-ea1df09786b2 tempest-VolumesListAdminTestJSON-1337639171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ab7f1a13-8ecc-4a99-8f63-ea1df09786b2 tempest-VolumesListAdminTestJSON-1337639171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ab7f1a13-8ecc-4a99-8f63-ea1df09786b2 tempest-VolumesListAdminTestJSON-1337639171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ab7f1a13-8ecc-4a99-8f63-ea1df09786b2 tempest-VolumesListAdminTestJSON-1337639171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ab7f1a13-8ecc-4a99-8f63-ea1df09786b2 tempest-VolumesListAdminTestJSON-1337639171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ab7f1a13-8ecc-4a99-8f63-ea1df09786b2 tempest-VolumesListAdminTestJSON-1337639171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:37 devstack sudo[89430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:11:37 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:37 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ca8931e1-ff1d-4192-a697-36b06dd292c8 tempest-VolumesListAdminTestJSON-666070959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.452s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-ca8931e1-ff1d-4192-a697-36b06dd292c8 tempest-VolumesListAdminTestJSON-666070959 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:37 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-ca8931e1-ff1d-4192-a697-36b06dd292c8 tempest-VolumesListAdminTestJSON-666070959 None] Deleted volume successfully. Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ca8931e1-ff1d-4192-a697-36b06dd292c8 tempest-VolumesListAdminTestJSON-666070959 None] Lock "cinder-da57e9fc-49b9-4033-8013-f421bcf8692f-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:37 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ab7f1a13-8ecc-4a99-8f63-ea1df09786b2 tempest-VolumesListAdminTestJSON-1337639171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.442s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-ab7f1a13-8ecc-4a99-8f63-ea1df09786b2 tempest-VolumesListAdminTestJSON-1337639171 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:37 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-ab7f1a13-8ecc-4a99-8f63-ea1df09786b2 tempest-VolumesListAdminTestJSON-1337639171 None] Deleted volume successfully. Feb 27 02:11:37 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-ab7f1a13-8ecc-4a99-8f63-ea1df09786b2 tempest-VolumesListAdminTestJSON-1337639171 None] Lock "cinder-48c881c0-3466-4c13-9766-7a61e72a6411-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:38 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-cbd8d3f0-ece5-4a61-9575-49109191f673 tempest-VolumesListAdminTestJSON-1337639171 None] Acquiring lock "cinder-a3c68329-ddde-4091-b835-3d7ec8bd4691-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:38 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-cbd8d3f0-ece5-4a61-9575-49109191f673 tempest-VolumesListAdminTestJSON-1337639171 None] Lock "cinder-a3c68329-ddde-4091-b835-3d7ec8bd4691-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:38 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-cbd8d3f0-ece5-4a61-9575-49109191f673 tempest-VolumesListAdminTestJSON-1337639171 None] Acquiring lock "cinder-quobyte-a3c68329-ddde-4091-b835-3d7ec8bd4691" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:38 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-cbd8d3f0-ece5-4a61-9575-49109191f673 tempest-VolumesListAdminTestJSON-1337639171 None] Lock "cinder-quobyte-a3c68329-ddde-4091-b835-3d7ec8bd4691" acquired by "delete_volume" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:38 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfbbffc-8713-4b6b-b564-705b8b0f7dd5]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cbd8d3f0-ece5-4a61-9575-49109191f673 tempest-VolumesListAdminTestJSON-1337639171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a3c68329-ddde-4091-b835-3d7ec8bd4691 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:38 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a3c68329-ddde-4091-b835-3d7ec8bd4691 Feb 27 02:11:38 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:39 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cbd8d3f0-ece5-4a61-9575-49109191f673 tempest-VolumesListAdminTestJSON-1337639171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a3c68329-ddde-4091-b835-3d7ec8bd4691" returned: 0 in 0.482s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cbd8d3f0-ece5-4a61-9575-49109191f673 tempest-VolumesListAdminTestJSON-1337639171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a3c68329-ddde-4091-b835-3d7ec8bd4691 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:39 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a3c68329-ddde-4091-b835-3d7ec8bd4691 Feb 27 02:11:39 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:39 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cbd8d3f0-ece5-4a61-9575-49109191f673 tempest-VolumesListAdminTestJSON-1337639171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a3c68329-ddde-4091-b835-3d7ec8bd4691" returned: 0 in 0.436s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:39 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-cbd8d3f0-ece5-4a61-9575-49109191f673 tempest-VolumesListAdminTestJSON-1337639171 None] Lock "cinder-quobyte-a3c68329-ddde-4091-b835-3d7ec8bd4691" released by "delete_volume" :: held 0.942s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:39 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-cbd8d3f0-ece5-4a61-9575-49109191f673 tempest-VolumesListAdminTestJSON-1337639171 None] Created reservations ['743ec12f-e87e-4e3f-99e6-88b33d6370f5', 'e2313b9d-2418-49f1-bf95-0b80d2c6c531', '3cf0f206-42d2-4adb-bb1f-b69fd4afda9e', 'dcf802d9-8f8d-4244-8c85-ec2925f35a80'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cbd8d3f0-ece5-4a61-9575-49109191f673 tempest-VolumesListAdminTestJSON-1337639171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cbd8d3f0-ece5-4a61-9575-49109191f673 tempest-VolumesListAdminTestJSON-1337639171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:39 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-cbd8d3f0-ece5-4a61-9575-49109191f673 tempest-VolumesListAdminTestJSON-1337639171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:39 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-cbd8d3f0-ece5-4a61-9575-49109191f673 tempest-VolumesListAdminTestJSON-1337639171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-cbd8d3f0-ece5-4a61-9575-49109191f673 tempest-VolumesListAdminTestJSON-1337639171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cbd8d3f0-ece5-4a61-9575-49109191f673 tempest-VolumesListAdminTestJSON-1337639171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:39 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:11:39 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:39 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-97f0d134-371d-49ee-a913-9b6bd53a627b tempest-VolumesListAdminTestJSON-1337639171 None] Acquiring lock "cinder-3084a706-8d35-4082-8d78-f7b0be2eb6aa-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:39 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-97f0d134-371d-49ee-a913-9b6bd53a627b tempest-VolumesListAdminTestJSON-1337639171 None] Lock "cinder-3084a706-8d35-4082-8d78-f7b0be2eb6aa-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:39 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-97f0d134-371d-49ee-a913-9b6bd53a627b tempest-VolumesListAdminTestJSON-1337639171 None] Acquiring lock "cinder-quobyte-3084a706-8d35-4082-8d78-f7b0be2eb6aa" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:39 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-97f0d134-371d-49ee-a913-9b6bd53a627b tempest-VolumesListAdminTestJSON-1337639171 None] Lock "cinder-quobyte-3084a706-8d35-4082-8d78-f7b0be2eb6aa" acquired by "delete_volume" :: waited 0.008s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:39 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[27aa0707-5e3b-4170-8af2-74fd7ee7548d]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-97f0d134-371d-49ee-a913-9b6bd53a627b tempest-VolumesListAdminTestJSON-1337639171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3084a706-8d35-4082-8d78-f7b0be2eb6aa {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:39 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3084a706-8d35-4082-8d78-f7b0be2eb6aa Feb 27 02:11:39 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:40 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-cbd8d3f0-ece5-4a61-9575-49109191f673 tempest-VolumesListAdminTestJSON-1337639171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.457s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:40 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-cbd8d3f0-ece5-4a61-9575-49109191f673 tempest-VolumesListAdminTestJSON-1337639171 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:40 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-cbd8d3f0-ece5-4a61-9575-49109191f673 tempest-VolumesListAdminTestJSON-1337639171 None] Deleted volume successfully. Feb 27 02:11:40 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-cbd8d3f0-ece5-4a61-9575-49109191f673 tempest-VolumesListAdminTestJSON-1337639171 None] Lock "cinder-a3c68329-ddde-4091-b835-3d7ec8bd4691-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:40 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-97f0d134-371d-49ee-a913-9b6bd53a627b tempest-VolumesListAdminTestJSON-1337639171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3084a706-8d35-4082-8d78-f7b0be2eb6aa" returned: 0 in 0.509s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-97f0d134-371d-49ee-a913-9b6bd53a627b tempest-VolumesListAdminTestJSON-1337639171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3084a706-8d35-4082-8d78-f7b0be2eb6aa {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:40 devstack sudo[89450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3084a706-8d35-4082-8d78-f7b0be2eb6aa Feb 27 02:11:40 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:40 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-97f0d134-371d-49ee-a913-9b6bd53a627b tempest-VolumesListAdminTestJSON-1337639171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3084a706-8d35-4082-8d78-f7b0be2eb6aa" returned: 0 in 0.438s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:40 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-97f0d134-371d-49ee-a913-9b6bd53a627b tempest-VolumesListAdminTestJSON-1337639171 None] Lock "cinder-quobyte-3084a706-8d35-4082-8d78-f7b0be2eb6aa" released by "delete_volume" :: held 0.970s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:40 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-97f0d134-371d-49ee-a913-9b6bd53a627b tempest-VolumesListAdminTestJSON-1337639171 None] Created reservations ['c1c74061-1b89-4944-a800-2765e9713379', '3be76aa2-ce7b-4542-be83-a2aece2748f4', 'b807ca72-6143-49ac-83e1-0515f8ab64ea', '5e210975-b00d-4d00-a20a-d04309fb95cd'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-97f0d134-371d-49ee-a913-9b6bd53a627b tempest-VolumesListAdminTestJSON-1337639171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-97f0d134-371d-49ee-a913-9b6bd53a627b tempest-VolumesListAdminTestJSON-1337639171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:40 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-97f0d134-371d-49ee-a913-9b6bd53a627b tempest-VolumesListAdminTestJSON-1337639171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:40 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-97f0d134-371d-49ee-a913-9b6bd53a627b tempest-VolumesListAdminTestJSON-1337639171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-97f0d134-371d-49ee-a913-9b6bd53a627b tempest-VolumesListAdminTestJSON-1337639171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-97f0d134-371d-49ee-a913-9b6bd53a627b tempest-VolumesListAdminTestJSON-1337639171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:40 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:11:40 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:41 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-97f0d134-371d-49ee-a913-9b6bd53a627b tempest-VolumesListAdminTestJSON-1337639171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.509s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:41 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-97f0d134-371d-49ee-a913-9b6bd53a627b tempest-VolumesListAdminTestJSON-1337639171 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:41 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-97f0d134-371d-49ee-a913-9b6bd53a627b tempest-VolumesListAdminTestJSON-1337639171 None] Deleted volume successfully. Feb 27 02:11:41 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-97f0d134-371d-49ee-a913-9b6bd53a627b tempest-VolumesListAdminTestJSON-1337639171 None] Lock "cinder-3084a706-8d35-4082-8d78-f7b0be2eb6aa-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Flow 'volume_create_manager' (8a313dbd-24bb-4cc5-a26e-5f0c9acbbf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c208ae-d71a-4c77-85d8-b76ec1ebf81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c208ae-d71a-4c77-85d8-b76ec1ebf81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-876164737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced1e570-75c4-41eb-be9b-b074d579620d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23aa439c947f42d29cdf975af43c45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:45Z,use_quota=True,user_id='6752e9d092ca4658b971a3425608d357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8d4675-16bc-435d-84ec-cb59623a4477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8d4675-16bc-435d-84ec-cb59623a4477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fecd5e5-ffb7-42b4-a743-d1f8c10cf3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fecd5e5-ffb7-42b4-a743-d1f8c10cf3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced1e570-75c4-41eb-be9b-b074d579620d', 'volume_name': 'volume-ced1e570-75c4-41eb-be9b-b074d579620d', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1e05ab-0c2c-43a8-b9ee-013088d49edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1e05ab-0c2c-43a8-b9ee-013088d49edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905450ea-8b64-43bb-a0d2-da4833a1993a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:45 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Volume ced1e570-75c4-41eb-be9b-b074d579620d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced1e570-75c4-41eb-be9b-b074d579620d', 'volume_size': 1} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-876164737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced1e570-75c4-41eb-be9b-b074d579620d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23aa439c947f42d29cdf975af43c45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:45Z,use_quota=True,user_id='6752e9d092ca4658b971a3425608d357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Creating volume ced1e570-75c4-41eb-be9b-b074d579620d {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:45 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:45 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d 1073741824 Feb 27 02:11:45 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:45 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d 1073741824" returned: 0 in 0.524s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:45 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d Feb 27 02:11:45 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:46 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d" returned: 0 in 0.444s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:46 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905450ea-8b64-43bb-a0d2-da4833a1993a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced1e570-75c4-41eb-be9b-b074d579620d', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:46 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79279bdd-5ad5-4da5-ad87-f3229e882848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:46 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Volume volume-ced1e570-75c4-41eb-be9b-b074d579620d (ced1e570-75c4-41eb-be9b-b074d579620d): created successfully Feb 27 02:11:46 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79279bdd-5ad5-4da5-ad87-f3229e882848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:46 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Flow 'volume_create_manager' (8a313dbd-24bb-4cc5-a26e-5f0c9acbbf89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:46 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-767b8613-bb85-4ac8-b453-2479dc0b2442 tempest-SnapshotMetadataTestJSON-529690614 None] Created volume successfully. Feb 27 02:11:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d5cc1172-d610-46a4-b61a-2fe31b0ed4b4 tempest-SnapshotMetadataTestJSON-529690614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d5cc1172-d610-46a4-b61a-2fe31b0ed4b4 tempest-SnapshotMetadataTestJSON-529690614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-d5cc1172-d610-46a4-b61a-2fe31b0ed4b4 tempest-SnapshotMetadataTestJSON-529690614 None] Creating offline snapshot 3137c448-ea4b-43d2-948a-183959722f3c of volume ced1e570-75c4-41eb-be9b-b074d579620d {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:11:47 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f574e0-96d6-4931-aadd-be391528e425]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d5cc1172-d610-46a4-b61a-2fe31b0ed4b4 tempest-SnapshotMetadataTestJSON-529690614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:47 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d Feb 27 02:11:47 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:48 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d5cc1172-d610-46a4-b61a-2fe31b0ed4b4 tempest-SnapshotMetadataTestJSON-529690614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d" returned: 0 in 0.561s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d5cc1172-d610-46a4-b61a-2fe31b0ed4b4 tempest-SnapshotMetadataTestJSON-529690614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.3137c448-ea4b-43d2-948a-183959722f3c 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:48 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.3137c448-ea4b-43d2-948a-183959722f3c 1G Feb 27 02:11:48 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:48 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d5cc1172-d610-46a4-b61a-2fe31b0ed4b4 tempest-SnapshotMetadataTestJSON-529690614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.3137c448-ea4b-43d2-948a-183959722f3c 1G" returned: 0 in 0.547s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d5cc1172-d610-46a4-b61a-2fe31b0ed4b4 tempest-SnapshotMetadataTestJSON-529690614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced1e570-75c4-41eb-be9b-b074d579620d -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.3137c448-ea4b-43d2-948a-183959722f3c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:48 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced1e570-75c4-41eb-be9b-b074d579620d -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.3137c448-ea4b-43d2-948a-183959722f3c Feb 27 02:11:48 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:49 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d5cc1172-d610-46a4-b61a-2fe31b0ed4b4 tempest-SnapshotMetadataTestJSON-529690614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced1e570-75c4-41eb-be9b-b074d579620d -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.3137c448-ea4b-43d2-948a-183959722f3c" returned: 0 in 0.451s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:49 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-d5cc1172-d610-46a4-b61a-2fe31b0ed4b4 tempest-SnapshotMetadataTestJSON-529690614 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.3137c448-ea4b-43d2-948a-183959722f3c is being set with open permissions: ugo+rw Feb 27 02:11:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d5cc1172-d610-46a4-b61a-2fe31b0ed4b4 tempest-SnapshotMetadataTestJSON-529690614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.3137c448-ea4b-43d2-948a-183959722f3c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:49 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.3137c448-ea4b-43d2-948a-183959722f3c Feb 27 02:11:49 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:49 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d5cc1172-d610-46a4-b61a-2fe31b0ed4b4 tempest-SnapshotMetadataTestJSON-529690614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.3137c448-ea4b-43d2-948a-183959722f3c" returned: 0 in 0.408s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d5cc1172-d610-46a4-b61a-2fe31b0ed4b4 tempest-SnapshotMetadataTestJSON-529690614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:49 devstack sudo[89484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.info Feb 27 02:11:49 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:49 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d5cc1172-d610-46a4-b61a-2fe31b0ed4b4 tempest-SnapshotMetadataTestJSON-529690614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.info" returned: 0 in 0.445s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:49 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-d5cc1172-d610-46a4-b61a-2fe31b0ed4b4 tempest-SnapshotMetadataTestJSON-529690614 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.info is being set with open permissions: ugo+rw Feb 27 02:11:49 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d5cc1172-d610-46a4-b61a-2fe31b0ed4b4 tempest-SnapshotMetadataTestJSON-529690614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:49 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.info Feb 27 02:11:49 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:50 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d5cc1172-d610-46a4-b61a-2fe31b0ed4b4 tempest-SnapshotMetadataTestJSON-529690614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.info" returned: 0 in 0.417s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d5cc1172-d610-46a4-b61a-2fe31b0ed4b4 tempest-SnapshotMetadataTestJSON-529690614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.898s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:50 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-d5cc1172-d610-46a4-b61a-2fe31b0ed4b4 tempest-SnapshotMetadataTestJSON-529690614 None] Create snapshot completed successfully Feb 27 02:11:51 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] Acquiring lock "cinder-3137c448-ea4b-43d2-948a-183959722f3c-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:51 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] Lock "cinder-3137c448-ea4b-43d2-948a-183959722f3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:51 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] Acquiring lock "cinder-quobyte-ced1e570-75c4-41eb-be9b-b074d579620d" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:51 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] Lock "cinder-quobyte-ced1e570-75c4-41eb-be9b-b074d579620d" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:51 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] Acquiring lock "cinder-quobyte-3137c448-ea4b-43d2-948a-183959722f3c" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:51 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] Lock "cinder-quobyte-3137c448-ea4b-43d2-948a-183959722f3c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] Deleting offline snapshot 3137c448-ea4b-43d2-948a-183959722f3c of volume ced1e570-75c4-41eb-be9b-b074d579620d {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:11:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] snapshot_file for this snap is: volume-ced1e570-75c4-41eb-be9b-b074d579620d.3137c448-ea4b-43d2-948a-183959722f3c {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:11:51 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe22401-a717-4a1c-96c6-c3fc4391f655]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.3137c448-ea4b-43d2-948a-183959722f3c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:51 devstack sudo[89491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.3137c448-ea4b-43d2-948a-183959722f3c Feb 27 02:11:51 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:51 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.3137c448-ea4b-43d2-948a-183959722f3c" returned: 0 in 0.469s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ced1e570-75c4-41eb-be9b-b074d579620d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:11:51 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[5454647f-57c5-45e1-a3bd-823fc9d5c83e]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:51 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d Feb 27 02:11:51 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:52 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d" returned: 0 in 0.509s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.3137c448-ea4b-43d2-948a-183959722f3c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:52 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.3137c448-ea4b-43d2-948a-183959722f3c Feb 27 02:11:52 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:52 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.3137c448-ea4b-43d2-948a-183959722f3c" returned: 0 in 0.490s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.3137c448-ea4b-43d2-948a-183959722f3c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:52 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.3137c448-ea4b-43d2-948a-183959722f3c Feb 27 02:11:52 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:53 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d.3137c448-ea4b-43d2-948a-183959722f3c" returned: 0 in 0.429s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:53 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] Lock "cinder-quobyte-3137c448-ea4b-43d2-948a-183959722f3c" released by "_delete_snapshot" :: held 1.958s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:53 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] Lock "cinder-quobyte-ced1e570-75c4-41eb-be9b-b074d579620d" released by "delete_snapshot" :: held 1.974s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:53 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] Created reservations ['020f81f1-98ba-499f-aefa-52488eae9e74', 'eb2b355d-c88d-48a4-88c4-4044e381497b', 'a4fec62a-612e-4e23-b06e-018effa8a25b', '585baa5f-a33e-415c-b688-ebf826f7eb07'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:53 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] Delete snapshot completed successfully. Feb 27 02:11:53 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-336c6ade-5dba-4c5d-b870-6ec055ef1dce tempest-SnapshotMetadataTestJSON-529690614 None] Lock "cinder-3137c448-ea4b-43d2-948a-183959722f3c-delete_snapshot" released by "delete_snapshot" :: held 2.085s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:53 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-814f7445-00db-48eb-83bc-702b0edc32dc tempest-SnapshotMetadataTestJSON-529690614 None] Acquiring lock "cinder-ced1e570-75c4-41eb-be9b-b074d579620d-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:53 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-814f7445-00db-48eb-83bc-702b0edc32dc tempest-SnapshotMetadataTestJSON-529690614 None] Lock "cinder-ced1e570-75c4-41eb-be9b-b074d579620d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:53 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-814f7445-00db-48eb-83bc-702b0edc32dc tempest-SnapshotMetadataTestJSON-529690614 None] Acquiring lock "cinder-quobyte-ced1e570-75c4-41eb-be9b-b074d579620d" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:53 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-814f7445-00db-48eb-83bc-702b0edc32dc tempest-SnapshotMetadataTestJSON-529690614 None] Lock "cinder-quobyte-ced1e570-75c4-41eb-be9b-b074d579620d" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:53 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[6641bdfd-64c3-4814-9a70-e7838a891feb]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-814f7445-00db-48eb-83bc-702b0edc32dc tempest-SnapshotMetadataTestJSON-529690614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:53 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d Feb 27 02:11:53 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:53 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-814f7445-00db-48eb-83bc-702b0edc32dc tempest-SnapshotMetadataTestJSON-529690614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d" returned: 0 in 0.504s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-814f7445-00db-48eb-83bc-702b0edc32dc tempest-SnapshotMetadataTestJSON-529690614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:53 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d Feb 27 02:11:53 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:54 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-814f7445-00db-48eb-83bc-702b0edc32dc tempest-SnapshotMetadataTestJSON-529690614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ced1e570-75c4-41eb-be9b-b074d579620d" returned: 0 in 0.439s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:54 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-814f7445-00db-48eb-83bc-702b0edc32dc tempest-SnapshotMetadataTestJSON-529690614 None] Lock "cinder-quobyte-ced1e570-75c4-41eb-be9b-b074d579620d" released by "delete_volume" :: held 0.993s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:54 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-814f7445-00db-48eb-83bc-702b0edc32dc tempest-SnapshotMetadataTestJSON-529690614 None] Created reservations ['3725335a-7d66-4939-8634-513cb2cba53f', 'da5c7d6d-93d3-443a-9f0a-3e432d24c0ce', '25587d22-a6aa-41d0-9c35-84f3dceec490', 'ed4c61ad-9976-4b56-9322-0cea13adf544'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-814f7445-00db-48eb-83bc-702b0edc32dc tempest-SnapshotMetadataTestJSON-529690614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-814f7445-00db-48eb-83bc-702b0edc32dc tempest-SnapshotMetadataTestJSON-529690614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-814f7445-00db-48eb-83bc-702b0edc32dc tempest-SnapshotMetadataTestJSON-529690614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-814f7445-00db-48eb-83bc-702b0edc32dc tempest-SnapshotMetadataTestJSON-529690614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-814f7445-00db-48eb-83bc-702b0edc32dc tempest-SnapshotMetadataTestJSON-529690614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-814f7445-00db-48eb-83bc-702b0edc32dc tempest-SnapshotMetadataTestJSON-529690614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:54 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:11:54 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:54 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-814f7445-00db-48eb-83bc-702b0edc32dc tempest-SnapshotMetadataTestJSON-529690614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.452s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:54 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-814f7445-00db-48eb-83bc-702b0edc32dc tempest-SnapshotMetadataTestJSON-529690614 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:54 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-814f7445-00db-48eb-83bc-702b0edc32dc tempest-SnapshotMetadataTestJSON-529690614 None] Deleted volume successfully. Feb 27 02:11:55 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-814f7445-00db-48eb-83bc-702b0edc32dc tempest-SnapshotMetadataTestJSON-529690614 None] Lock "cinder-ced1e570-75c4-41eb-be9b-b074d579620d-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Flow 'volume_create_manager' (44fefd31-0b99-49b6-b5d3-86406f4c1fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31fee4b-c70b-4eb3-bb6d-cb24b0d33c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31fee4b-c70b-4eb3-bb6d-cb24b0d33c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1576092434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2aa7d1-16f5-4033-b533-8e12e1848bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf20537169a41aa8fd23d7bf80aa324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:58Z,use_quota=True,user_id='f951153d32b343f69c7660a082da8847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5360834-0cfa-4639-ac66-1dbc98074240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5360834-0cfa-4639-ac66-1dbc98074240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0205b17a-af50-4d98-8f1c-66edcc34fbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0205b17a-af50-4d98-8f1c-66edcc34fbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f2aa7d1-16f5-4033-b533-8e12e1848bf1', 'volume_name': 'volume-7f2aa7d1-16f5-4033-b533-8e12e1848bf1', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d00dc57-b928-46e7-a12a-86116447c03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d00dc57-b928-46e7-a12a-86116447c03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c182e68a-b201-4b33-a28d-813d4470ccfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:58 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Volume 7f2aa7d1-16f5-4033-b533-8e12e1848bf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f2aa7d1-16f5-4033-b533-8e12e1848bf1', 'volume_size': 1} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1576092434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2aa7d1-16f5-4033-b533-8e12e1848bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf20537169a41aa8fd23d7bf80aa324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:58Z,use_quota=True,user_id='f951153d32b343f69c7660a082da8847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Creating volume 7f2aa7d1-16f5-4033-b533-8e12e1848bf1 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:58 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f2aa7d1-16f5-4033-b533-8e12e1848bf1 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:58 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f2aa7d1-16f5-4033-b533-8e12e1848bf1 1073741824 Feb 27 02:11:58 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:58 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f2aa7d1-16f5-4033-b533-8e12e1848bf1 1073741824" returned: 0 in 0.469s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f2aa7d1-16f5-4033-b533-8e12e1848bf1 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:59 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f2aa7d1-16f5-4033-b533-8e12e1848bf1 Feb 27 02:11:59 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:59 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f2aa7d1-16f5-4033-b533-8e12e1848bf1" returned: 0 in 0.422s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c182e68a-b201-4b33-a28d-813d4470ccfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f2aa7d1-16f5-4033-b533-8e12e1848bf1', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d97337-4566-4f7d-bbba-750e9d54031f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:59 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Volume volume-7f2aa7d1-16f5-4033-b533-8e12e1848bf1 (7f2aa7d1-16f5-4033-b533-8e12e1848bf1): created successfully Feb 27 02:11:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d97337-4566-4f7d-bbba-750e9d54031f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:59 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Flow 'volume_create_manager' (44fefd31-0b99-49b6-b5d3-86406f4c1fcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:59 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-fd54f113-6ff4-4816-bf2a-49ea126623aa tempest-AbsoluteLimitsTests-1462057225 None] Created volume successfully. Feb 27 02:12:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-40a88991-d2a7-40e8-a079-ca6a52803c5b tempest-AbsoluteLimitsTests-1462057225 None] Acquiring lock "cinder-7f2aa7d1-16f5-4033-b533-8e12e1848bf1-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-40a88991-d2a7-40e8-a079-ca6a52803c5b tempest-AbsoluteLimitsTests-1462057225 None] Lock "cinder-7f2aa7d1-16f5-4033-b533-8e12e1848bf1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-40a88991-d2a7-40e8-a079-ca6a52803c5b tempest-AbsoluteLimitsTests-1462057225 None] Acquiring lock "cinder-quobyte-7f2aa7d1-16f5-4033-b533-8e12e1848bf1" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-40a88991-d2a7-40e8-a079-ca6a52803c5b tempest-AbsoluteLimitsTests-1462057225 None] Lock "cinder-quobyte-7f2aa7d1-16f5-4033-b533-8e12e1848bf1" acquired by "delete_volume" :: waited 0.007s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:00 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eae97c8-a0d1-4725-b476-d463ab8b8d08]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-40a88991-d2a7-40e8-a079-ca6a52803c5b tempest-AbsoluteLimitsTests-1462057225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f2aa7d1-16f5-4033-b533-8e12e1848bf1 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:00 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f2aa7d1-16f5-4033-b533-8e12e1848bf1 Feb 27 02:12:00 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:01 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-40a88991-d2a7-40e8-a079-ca6a52803c5b tempest-AbsoluteLimitsTests-1462057225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f2aa7d1-16f5-4033-b533-8e12e1848bf1" returned: 0 in 0.482s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-40a88991-d2a7-40e8-a079-ca6a52803c5b tempest-AbsoluteLimitsTests-1462057225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f2aa7d1-16f5-4033-b533-8e12e1848bf1 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:01 devstack sudo[89534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f2aa7d1-16f5-4033-b533-8e12e1848bf1 Feb 27 02:12:01 devstack sudo[89534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:01 devstack sudo[89534]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-40a88991-d2a7-40e8-a079-ca6a52803c5b tempest-AbsoluteLimitsTests-1462057225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7f2aa7d1-16f5-4033-b533-8e12e1848bf1" returned: 0 in 0.423s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:01 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-40a88991-d2a7-40e8-a079-ca6a52803c5b tempest-AbsoluteLimitsTests-1462057225 None] Lock "cinder-quobyte-7f2aa7d1-16f5-4033-b533-8e12e1848bf1" released by "delete_volume" :: held 0.939s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:01 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-40a88991-d2a7-40e8-a079-ca6a52803c5b tempest-AbsoluteLimitsTests-1462057225 None] Created reservations ['5daa5dc9-bffb-42c6-a4f5-e531371b6d5f', '7ebcc084-a209-43cc-ac20-6ff65c3a01bd', '3aa192cc-9ea7-4999-8750-e85acffeeafc', '54ea47b3-f107-494d-9168-98e7d7b51474'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-40a88991-d2a7-40e8-a079-ca6a52803c5b tempest-AbsoluteLimitsTests-1462057225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-40a88991-d2a7-40e8-a079-ca6a52803c5b tempest-AbsoluteLimitsTests-1462057225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-40a88991-d2a7-40e8-a079-ca6a52803c5b tempest-AbsoluteLimitsTests-1462057225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-40a88991-d2a7-40e8-a079-ca6a52803c5b tempest-AbsoluteLimitsTests-1462057225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-40a88991-d2a7-40e8-a079-ca6a52803c5b tempest-AbsoluteLimitsTests-1462057225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-40a88991-d2a7-40e8-a079-ca6a52803c5b tempest-AbsoluteLimitsTests-1462057225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:01 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:12:01 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:02 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-40a88991-d2a7-40e8-a079-ca6a52803c5b tempest-AbsoluteLimitsTests-1462057225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.484s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:02 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-40a88991-d2a7-40e8-a079-ca6a52803c5b tempest-AbsoluteLimitsTests-1462057225 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:02 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-40a88991-d2a7-40e8-a079-ca6a52803c5b tempest-AbsoluteLimitsTests-1462057225 None] Deleted volume successfully. Feb 27 02:12:02 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-40a88991-d2a7-40e8-a079-ca6a52803c5b tempest-AbsoluteLimitsTests-1462057225 None] Lock "cinder-7f2aa7d1-16f5-4033-b533-8e12e1848bf1-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Flow 'volume_create_manager' (5255a80e-373d-4d3f-8ac2-f8ad42006d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29bfbd8-dac8-4ae4-9864-11faeaf06b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29bfbd8-dac8-4ae4-9864-11faeaf06b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1856664843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463b3a01-fed3-4ef2-a2bd-4a0410bead6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6560f85da5463bac5f16c1df7f2110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:06Z,use_quota=True,user_id='1620e5db2c0b4bab9fba5fb9c832dc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588b3e13-2890-4d60-96a8-5183a5572398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588b3e13-2890-4d60-96a8-5183a5572398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d758da7c-f4f7-4d32-9aa9-00c8fb9162fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d758da7c-f4f7-4d32-9aa9-00c8fb9162fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '463b3a01-fed3-4ef2-a2bd-4a0410bead6d', 'volume_name': 'volume-463b3a01-fed3-4ef2-a2bd-4a0410bead6d', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6189eb7-bbac-4848-bf3c-4187dc27cd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6189eb7-bbac-4848-bf3c-4187dc27cd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f4fbfc-1bac-4589-8708-b0f7919f84dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:05 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Volume 463b3a01-fed3-4ef2-a2bd-4a0410bead6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-463b3a01-fed3-4ef2-a2bd-4a0410bead6d', 'volume_size': 1} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1856664843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463b3a01-fed3-4ef2-a2bd-4a0410bead6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6560f85da5463bac5f16c1df7f2110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:06Z,use_quota=True,user_id='1620e5db2c0b4bab9fba5fb9c832dc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Creating volume 463b3a01-fed3-4ef2-a2bd-4a0410bead6d {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:05 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:12:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-463b3a01-fed3-4ef2-a2bd-4a0410bead6d 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:05 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-463b3a01-fed3-4ef2-a2bd-4a0410bead6d 1073741824 Feb 27 02:12:05 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:06 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-463b3a01-fed3-4ef2-a2bd-4a0410bead6d 1073741824" returned: 0 in 0.516s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-463b3a01-fed3-4ef2-a2bd-4a0410bead6d {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:06 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-463b3a01-fed3-4ef2-a2bd-4a0410bead6d Feb 27 02:12:06 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:06 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-463b3a01-fed3-4ef2-a2bd-4a0410bead6d" returned: 0 in 0.414s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:06 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f4fbfc-1bac-4589-8708-b0f7919f84dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-463b3a01-fed3-4ef2-a2bd-4a0410bead6d', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17377543-b3e4-48ab-819e-be06264a814a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:06 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Volume volume-463b3a01-fed3-4ef2-a2bd-4a0410bead6d (463b3a01-fed3-4ef2-a2bd-4a0410bead6d): created successfully Feb 27 02:12:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17377543-b3e4-48ab-819e-be06264a814a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Flow 'volume_create_manager' (5255a80e-373d-4d3f-8ac2-f8ad42006d0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:06 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-ced57d7e-46b3-411a-bc67-87db1b74e4fb tempest-VolumesTransfersV355Test-1054964090 None] Created volume successfully. Feb 27 02:12:08 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-1b8815ab-e0de-4061-be97-be59e4978829 tempest-VolumesTransfersV355Test-1833785507 None] Transfer volume completed successfully. Feb 27 02:12:09 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d58d33b9-6587-4ce8-a328-1a08dae96646 tempest-VolumesTransfersV355Test-1646946899 None] Acquiring lock "cinder-463b3a01-fed3-4ef2-a2bd-4a0410bead6d-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:09 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d58d33b9-6587-4ce8-a328-1a08dae96646 tempest-VolumesTransfersV355Test-1646946899 None] Lock "cinder-463b3a01-fed3-4ef2-a2bd-4a0410bead6d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:09 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d58d33b9-6587-4ce8-a328-1a08dae96646 tempest-VolumesTransfersV355Test-1646946899 None] Acquiring lock "cinder-quobyte-463b3a01-fed3-4ef2-a2bd-4a0410bead6d" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:09 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d58d33b9-6587-4ce8-a328-1a08dae96646 tempest-VolumesTransfersV355Test-1646946899 None] Lock "cinder-quobyte-463b3a01-fed3-4ef2-a2bd-4a0410bead6d" acquired by "delete_volume" :: waited 0.008s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:09 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[9446eeee-f3da-4eed-a7d0-99a4f6e53d92]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d58d33b9-6587-4ce8-a328-1a08dae96646 tempest-VolumesTransfersV355Test-1646946899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-463b3a01-fed3-4ef2-a2bd-4a0410bead6d {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:09 devstack sudo[89551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-463b3a01-fed3-4ef2-a2bd-4a0410bead6d Feb 27 02:12:09 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:09 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d58d33b9-6587-4ce8-a328-1a08dae96646 tempest-VolumesTransfersV355Test-1646946899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-463b3a01-fed3-4ef2-a2bd-4a0410bead6d" returned: 0 in 0.588s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d58d33b9-6587-4ce8-a328-1a08dae96646 tempest-VolumesTransfersV355Test-1646946899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-463b3a01-fed3-4ef2-a2bd-4a0410bead6d {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:09 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-463b3a01-fed3-4ef2-a2bd-4a0410bead6d Feb 27 02:12:09 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:10 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d58d33b9-6587-4ce8-a328-1a08dae96646 tempest-VolumesTransfersV355Test-1646946899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-463b3a01-fed3-4ef2-a2bd-4a0410bead6d" returned: 0 in 0.483s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:10 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d58d33b9-6587-4ce8-a328-1a08dae96646 tempest-VolumesTransfersV355Test-1646946899 None] Lock "cinder-quobyte-463b3a01-fed3-4ef2-a2bd-4a0410bead6d" released by "delete_volume" :: held 1.097s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:10 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-d58d33b9-6587-4ce8-a328-1a08dae96646 tempest-VolumesTransfersV355Test-1646946899 None] Created reservations ['e9244056-5967-4a3f-b252-ea6aaf4056d2', '63908810-65ea-443d-b0e8-266f4063e165', '3923f4e5-97bc-433f-9a0f-9d89a9cc56c0', 'f9c9de6f-4a81-4d7d-9b58-b0e0970835fc'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d58d33b9-6587-4ce8-a328-1a08dae96646 tempest-VolumesTransfersV355Test-1646946899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d58d33b9-6587-4ce8-a328-1a08dae96646 tempest-VolumesTransfersV355Test-1646946899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d58d33b9-6587-4ce8-a328-1a08dae96646 tempest-VolumesTransfersV355Test-1646946899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d58d33b9-6587-4ce8-a328-1a08dae96646 tempest-VolumesTransfersV355Test-1646946899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d58d33b9-6587-4ce8-a328-1a08dae96646 tempest-VolumesTransfersV355Test-1646946899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d58d33b9-6587-4ce8-a328-1a08dae96646 tempest-VolumesTransfersV355Test-1646946899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:10 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:12:10 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:10 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d58d33b9-6587-4ce8-a328-1a08dae96646 tempest-VolumesTransfersV355Test-1646946899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.480s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:10 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-d58d33b9-6587-4ce8-a328-1a08dae96646 tempest-VolumesTransfersV355Test-1646946899 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:10 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-d58d33b9-6587-4ce8-a328-1a08dae96646 tempest-VolumesTransfersV355Test-1646946899 None] Deleted volume successfully. Feb 27 02:12:10 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d58d33b9-6587-4ce8-a328-1a08dae96646 tempest-VolumesTransfersV355Test-1646946899 None] Lock "cinder-463b3a01-fed3-4ef2-a2bd-4a0410bead6d-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Flow 'volume_create_manager' (a64b1792-a618-4444-872c-b8a8090ea276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c2f350-c7ba-43e9-9391-2fb53c4ad85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c2f350-c7ba-43e9-9391-2fb53c4ad85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2074925006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df5ed2d6-a93e-4257-b796-cf072fb62fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6560f85da5463bac5f16c1df7f2110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:11Z,use_quota=True,user_id='1620e5db2c0b4bab9fba5fb9c832dc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69122a1d-39e3-48e6-9151-6147722fa754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69122a1d-39e3-48e6-9151-6147722fa754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0167823-ca66-48f1-8968-74d95f540173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0167823-ca66-48f1-8968-74d95f540173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df5ed2d6-a93e-4257-b796-cf072fb62fd8', 'volume_name': 'volume-df5ed2d6-a93e-4257-b796-cf072fb62fd8', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (633a304f-d6d5-43fa-bb22-ec17b348cc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (633a304f-d6d5-43fa-bb22-ec17b348cc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a243e3-ce10-4e8a-a4e7-997087a3ac8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:11 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Volume df5ed2d6-a93e-4257-b796-cf072fb62fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df5ed2d6-a93e-4257-b796-cf072fb62fd8', 'volume_size': 1} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2074925006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df5ed2d6-a93e-4257-b796-cf072fb62fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6560f85da5463bac5f16c1df7f2110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:11Z,use_quota=True,user_id='1620e5db2c0b4bab9fba5fb9c832dc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Creating volume df5ed2d6-a93e-4257-b796-cf072fb62fd8 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:11 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:12:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-df5ed2d6-a93e-4257-b796-cf072fb62fd8 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:11 devstack sudo[89563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-df5ed2d6-a93e-4257-b796-cf072fb62fd8 1073741824 Feb 27 02:12:11 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:12 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-df5ed2d6-a93e-4257-b796-cf072fb62fd8 1073741824" returned: 0 in 0.527s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-df5ed2d6-a93e-4257-b796-cf072fb62fd8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:12 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-df5ed2d6-a93e-4257-b796-cf072fb62fd8 Feb 27 02:12:12 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:12 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-df5ed2d6-a93e-4257-b796-cf072fb62fd8" returned: 0 in 0.456s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a243e3-ce10-4e8a-a4e7-997087a3ac8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df5ed2d6-a93e-4257-b796-cf072fb62fd8', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35bd1ff6-309c-4e30-8fd7-b191e19fc134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:12 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Volume volume-df5ed2d6-a93e-4257-b796-cf072fb62fd8 (df5ed2d6-a93e-4257-b796-cf072fb62fd8): created successfully Feb 27 02:12:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35bd1ff6-309c-4e30-8fd7-b191e19fc134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Flow 'volume_create_manager' (a64b1792-a618-4444-872c-b8a8090ea276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:12 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=69,cinder:INSERT=28,cinder:UPDATE=112,cinder:DELETE=8 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:12:12 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-14660563-52ef-43fc-a12e-4d03b5116baf tempest-VolumesTransfersV355Test-1054964090 None] Created volume successfully. Feb 27 02:12:12 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:INSERT=22,cinder:UPDATE=100,cinder:SELECT=73,cinder:DELETE=11 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:12:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0619d14c-91e9-4142-b5c0-e78e1c3bfbc7 tempest-VolumesTransfersV355Test-1646946899 None] Acquiring lock "cinder-df5ed2d6-a93e-4257-b796-cf072fb62fd8-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0619d14c-91e9-4142-b5c0-e78e1c3bfbc7 tempest-VolumesTransfersV355Test-1646946899 None] Lock "cinder-df5ed2d6-a93e-4257-b796-cf072fb62fd8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0619d14c-91e9-4142-b5c0-e78e1c3bfbc7 tempest-VolumesTransfersV355Test-1646946899 None] Acquiring lock "cinder-quobyte-df5ed2d6-a93e-4257-b796-cf072fb62fd8" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0619d14c-91e9-4142-b5c0-e78e1c3bfbc7 tempest-VolumesTransfersV355Test-1646946899 None] Lock "cinder-quobyte-df5ed2d6-a93e-4257-b796-cf072fb62fd8" acquired by "delete_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:13 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a4c79c-c471-435e-9db9-75a15bf1e74c]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0619d14c-91e9-4142-b5c0-e78e1c3bfbc7 tempest-VolumesTransfersV355Test-1646946899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-df5ed2d6-a93e-4257-b796-cf072fb62fd8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:14 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-df5ed2d6-a93e-4257-b796-cf072fb62fd8 Feb 27 02:12:14 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:14 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0619d14c-91e9-4142-b5c0-e78e1c3bfbc7 tempest-VolumesTransfersV355Test-1646946899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-df5ed2d6-a93e-4257-b796-cf072fb62fd8" returned: 0 in 0.480s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0619d14c-91e9-4142-b5c0-e78e1c3bfbc7 tempest-VolumesTransfersV355Test-1646946899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-df5ed2d6-a93e-4257-b796-cf072fb62fd8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:14 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-df5ed2d6-a93e-4257-b796-cf072fb62fd8 Feb 27 02:12:14 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:14 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0619d14c-91e9-4142-b5c0-e78e1c3bfbc7 tempest-VolumesTransfersV355Test-1646946899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-df5ed2d6-a93e-4257-b796-cf072fb62fd8" returned: 0 in 0.416s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:14 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0619d14c-91e9-4142-b5c0-e78e1c3bfbc7 tempest-VolumesTransfersV355Test-1646946899 None] Lock "cinder-quobyte-df5ed2d6-a93e-4257-b796-cf072fb62fd8" released by "delete_volume" :: held 0.925s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:14 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-0619d14c-91e9-4142-b5c0-e78e1c3bfbc7 tempest-VolumesTransfersV355Test-1646946899 None] Created reservations ['2921e8bc-e5df-4119-a579-e58e9810b2d3', 'af1330a1-05f3-41cf-ae6e-119046ea4cd1', '7dc3c287-d009-4c53-8f34-38ad0dbe4a94', 'df520b87-b374-4644-b686-fc444c09777a'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0619d14c-91e9-4142-b5c0-e78e1c3bfbc7 tempest-VolumesTransfersV355Test-1646946899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0619d14c-91e9-4142-b5c0-e78e1c3bfbc7 tempest-VolumesTransfersV355Test-1646946899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:14 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0619d14c-91e9-4142-b5c0-e78e1c3bfbc7 tempest-VolumesTransfersV355Test-1646946899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:14 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0619d14c-91e9-4142-b5c0-e78e1c3bfbc7 tempest-VolumesTransfersV355Test-1646946899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0619d14c-91e9-4142-b5c0-e78e1c3bfbc7 tempest-VolumesTransfersV355Test-1646946899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0619d14c-91e9-4142-b5c0-e78e1c3bfbc7 tempest-VolumesTransfersV355Test-1646946899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:14 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:12:14 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:15 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0619d14c-91e9-4142-b5c0-e78e1c3bfbc7 tempest-VolumesTransfersV355Test-1646946899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.463s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:15 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-0619d14c-91e9-4142-b5c0-e78e1c3bfbc7 tempest-VolumesTransfersV355Test-1646946899 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:15 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-0619d14c-91e9-4142-b5c0-e78e1c3bfbc7 tempest-VolumesTransfersV355Test-1646946899 None] Deleted volume successfully. Feb 27 02:12:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0619d14c-91e9-4142-b5c0-e78e1c3bfbc7 tempest-VolumesTransfersV355Test-1646946899 None] Lock "cinder-df5ed2d6-a93e-4257-b796-cf072fb62fd8-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:23 devstack cinder-volume[82738]: DEBUG oslo_service.periodic_task [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82738) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:12:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:23 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:12:23 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:24 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.473s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:24 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:24 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:UPDATE=7,cinder:SELECT=4,cinder:INSERT=3 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:12:25 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Flow 'volume_create_manager' (e0850a11-dbb0-41d0-bb4b-01f7d5423fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0fa7965-c108-4acc-926d-91ccf8b3aeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0fa7965-c108-4acc-926d-91ccf8b3aeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-430684905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd8dc62-a515-4108-8551-9578ab6772f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e473f083723140808da77fb79b9480f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:27Z,use_quota=True,user_id='8e0095b2f4994715a000f23d4ef416c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd20935-9d60-4bd1-a823-a573f16610c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd20935-9d60-4bd1-a823-a573f16610c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76411459-e593-404f-aebc-b3f6d2e5dea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76411459-e593-404f-aebc-b3f6d2e5dea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fd8dc62-a515-4108-8551-9578ab6772f5', 'volume_name': 'volume-5fd8dc62-a515-4108-8551-9578ab6772f5', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad706d0-ac2f-4d93-a2af-7f58f734a771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad706d0-ac2f-4d93-a2af-7f58f734a771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b7bbc4-dc82-4cbd-81c5-5b1d01dff2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:26 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Volume 5fd8dc62-a515-4108-8551-9578ab6772f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fd8dc62-a515-4108-8551-9578ab6772f5', 'volume_size': 1} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-430684905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd8dc62-a515-4108-8551-9578ab6772f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e473f083723140808da77fb79b9480f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:27Z,use_quota=True,user_id='8e0095b2f4994715a000f23d4ef416c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Creating volume 5fd8dc62-a515-4108-8551-9578ab6772f5 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:26 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:12:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:26 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 1073741824 Feb 27 02:12:26 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:27 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 1073741824" returned: 0 in 0.562s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:27 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 Feb 27 02:12:27 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:27 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5" returned: 0 in 0.429s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:27 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b7bbc4-dc82-4cbd-81c5-5b1d01dff2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd8dc62-a515-4108-8551-9578ab6772f5', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6962cd31-20c7-41e2-abe4-9ac32176bc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:27 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Volume volume-5fd8dc62-a515-4108-8551-9578ab6772f5 (5fd8dc62-a515-4108-8551-9578ab6772f5): created successfully Feb 27 02:12:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6962cd31-20c7-41e2-abe4-9ac32176bc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:27 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Flow 'volume_create_manager' (e0850a11-dbb0-41d0-bb4b-01f7d5423fde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:27 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-677dd75f-86e7-4d22-bc96-b7faaa5ab402 tempest-VolumesActionsTest-132791294 None] Created volume successfully. Feb 27 02:12:37 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:12:37 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:12:42 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8a978fc0-c937-4d54-a30b-883159a41647 tempest-VolumesActionsTest-132791294 None] Acquiring lock "cinder-5fd8dc62-a515-4108-8551-9578ab6772f5" by "attach_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:42 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8a978fc0-c937-4d54-a30b-883159a41647 tempest-VolumesActionsTest-132791294 None] Lock "cinder-5fd8dc62-a515-4108-8551-9578ab6772f5" acquired by "attach_volume" :: waited 0.008s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:42 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-8a978fc0-c937-4d54-a30b-883159a41647 tempest-VolumesActionsTest-132791294 None] Attaching volume 5fd8dc62-a515-4108-8551-9578ab6772f5 to instance 19c39e69-4f71-4474-bfcc-d940c7f45f62 at mountpoint /dev/vdb on host None. Feb 27 02:12:42 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-8a978fc0-c937-4d54-a30b-883159a41647 tempest-VolumesActionsTest-132791294 None] Attach volume completed successfully. Feb 27 02:12:42 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8a978fc0-c937-4d54-a30b-883159a41647 tempest-VolumesActionsTest-132791294 None] Lock "cinder-5fd8dc62-a515-4108-8551-9578ab6772f5" released by "attach_volume" :: held 0.052s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9878559f-7820-442b-b09e-ac8446c1fe12 tempest-VolumesActionsTest-132791294 None] Acquiring lock "cinder-5fd8dc62-a515-4108-8551-9578ab6772f5-detach_volume" by "detach_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9878559f-7820-442b-b09e-ac8446c1fe12 tempest-VolumesActionsTest-132791294 None] Lock "cinder-5fd8dc62-a515-4108-8551-9578ab6772f5-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:43 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-9878559f-7820-442b-b09e-ac8446c1fe12 tempest-VolumesActionsTest-132791294 None] Detaching volume 5fd8dc62-a515-4108-8551-9578ab6772f5 from instance 19c39e69-4f71-4474-bfcc-d940c7f45f62. Feb 27 02:12:43 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-9878559f-7820-442b-b09e-ac8446c1fe12 tempest-VolumesActionsTest-132791294 None] Detach volume completed successfully. Feb 27 02:12:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9878559f-7820-442b-b09e-ac8446c1fe12 tempest-VolumesActionsTest-132791294 None] Lock "cinder-5fd8dc62-a515-4108-8551-9578ab6772f5-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:53 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:INSERT=1,cinder:SELECT=6,cinder:UPDATE=4 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:12:53 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:13:12 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1fac3fb3-f9a7-4a7e-8df2-d9a77bf3bfcc tempest-VolumesActionsTest-132791294 None] Acquiring lock "cinder-5fd8dc62-a515-4108-8551-9578ab6772f5" by "attach_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:12 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1fac3fb3-f9a7-4a7e-8df2-d9a77bf3bfcc tempest-VolumesActionsTest-132791294 None] Lock "cinder-5fd8dc62-a515-4108-8551-9578ab6772f5" acquired by "attach_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:12 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-1fac3fb3-f9a7-4a7e-8df2-d9a77bf3bfcc tempest-VolumesActionsTest-132791294 None] Attaching volume 5fd8dc62-a515-4108-8551-9578ab6772f5 to instance 9c4f80a9-0bab-4171-b639-4a81626eac10 at mountpoint /dev/vdb on host None. Feb 27 02:13:12 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-1fac3fb3-f9a7-4a7e-8df2-d9a77bf3bfcc tempest-VolumesActionsTest-132791294 None] Attach volume completed successfully. Feb 27 02:13:12 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1fac3fb3-f9a7-4a7e-8df2-d9a77bf3bfcc tempest-VolumesActionsTest-132791294 None] Lock "cinder-5fd8dc62-a515-4108-8551-9578ab6772f5" released by "attach_volume" :: held 0.056s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4d8d06fb-1ee7-4fbb-8d1b-e39d89c6cec5 tempest-VolumesActionsTest-132791294 None] Acquiring lock "cinder-5fd8dc62-a515-4108-8551-9578ab6772f5-detach_volume" by "detach_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4d8d06fb-1ee7-4fbb-8d1b-e39d89c6cec5 tempest-VolumesActionsTest-132791294 None] Lock "cinder-5fd8dc62-a515-4108-8551-9578ab6772f5-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:13 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-4d8d06fb-1ee7-4fbb-8d1b-e39d89c6cec5 tempest-VolumesActionsTest-132791294 None] Detaching volume 5fd8dc62-a515-4108-8551-9578ab6772f5 from instance 9c4f80a9-0bab-4171-b639-4a81626eac10. Feb 27 02:13:13 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-4d8d06fb-1ee7-4fbb-8d1b-e39d89c6cec5 tempest-VolumesActionsTest-132791294 None] Detach volume completed successfully. Feb 27 02:13:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4d8d06fb-1ee7-4fbb-8d1b-e39d89c6cec5 tempest-VolumesActionsTest-132791294 None] Lock "cinder-5fd8dc62-a515-4108-8551-9578ab6772f5-detach_volume" released by "detach_volume" :: held 0.035s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4b67c4f9-c0d7-4868-89d8-ea11f2122c49 tempest-VolumesActionsTest-132791294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4b67c4f9-c0d7-4868-89d8-ea11f2122c49 tempest-VolumesActionsTest-132791294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:21 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c01680b-24e3-4649-b2e6-8f3623cad4a1]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4b67c4f9-c0d7-4868-89d8-ea11f2122c49 tempest-VolumesActionsTest-132791294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:21 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 Feb 27 02:13:21 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:21 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4b67c4f9-c0d7-4868-89d8-ea11f2122c49 tempest-VolumesActionsTest-132791294 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5" returned: 0 in 0.484s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:21 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[667080b5-eb61-4720-a48c-cf818dd1bcd5]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4b67c4f9-c0d7-4868-89d8-ea11f2122c49 tempest-VolumesActionsTest-132791294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:22 devstack sudo[89851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 Feb 27 02:13:22 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:22 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4b67c4f9-c0d7-4868-89d8-ea11f2122c49 tempest-VolumesActionsTest-132791294 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5" returned: 0 in 0.468s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4b67c4f9-c0d7-4868-89d8-ea11f2122c49 tempest-VolumesActionsTest-132791294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 /opt/stack/data/cinder/conversion/5fd8dc62-a515-4108-8551-9578ab6772f5.temp_image.eee648b3-70bc-43be-983b-582ca57d58388kvwx6x3.img {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:22 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 /opt/stack/data/cinder/conversion/5fd8dc62-a515-4108-8551-9578ab6772f5.temp_image.eee648b3-70bc-43be-983b-582ca57d58388kvwx6x3.img Feb 27 02:13:22 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:23 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=5 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:13:23 devstack cinder-volume[82738]: DEBUG oslo_service.periodic_task [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82738) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:13:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:23 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:13:23 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:24 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4b67c4f9-c0d7-4868-89d8-ea11f2122c49 tempest-VolumesActionsTest-132791294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 /opt/stack/data/cinder/conversion/5fd8dc62-a515-4108-8551-9578ab6772f5.temp_image.eee648b3-70bc-43be-983b-582ca57d58388kvwx6x3.img" returned: 0 in 1.934s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:24 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb3e943-8288-4cf2-8468-438ffbcc79cd]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4b67c4f9-c0d7-4868-89d8-ea11f2122c49 tempest-VolumesActionsTest-132791294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:24 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.749s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:24 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:13:24 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 Feb 27 02:13:24 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:24 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4b67c4f9-c0d7-4868-89d8-ea11f2122c49 tempest-VolumesActionsTest-132791294 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5" returned: 0 in 0.592s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:24 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-4b67c4f9-c0d7-4868-89d8-ea11f2122c49 tempest-VolumesActionsTest-132791294 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5, size 1024.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/conversion/5fd8dc62-a515-4108-8551-9578ab6772f5.temp_image.eee648b3-70bc-43be-983b-582ca57d58388kvwx6x3.img {{(pid=82738) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:13:24 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-4b67c4f9-c0d7-4868-89d8-ea11f2122c49 tempest-VolumesActionsTest-132791294 None] Converted 1024.00 MB image at 529.24 MB/s Feb 27 02:13:25 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-4b67c4f9-c0d7-4868-89d8-ea11f2122c49 tempest-VolumesActionsTest-132791294 None] eee648b3-70bc-43be-983b-582ca57d5838 was raw, no need to convert to raw {{(pid=82738) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Feb 27 02:13:34 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:13:35 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=1 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:13:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4b67c4f9-c0d7-4868-89d8-ea11f2122c49 tempest-VolumesActionsTest-132791294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.194s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:36 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-4b67c4f9-c0d7-4868-89d8-ea11f2122c49 tempest-VolumesActionsTest-132791294 None] Uploaded volume to glance image-id: eee648b3-70bc-43be-983b-582ca57d5838. {{(pid=82738) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 27 02:13:37 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-4b67c4f9-c0d7-4868-89d8-ea11f2122c49 tempest-VolumesActionsTest-132791294 None] Copy volume to image completed successfully. Feb 27 02:13:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:39 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[480d75c1-1034-46f5-a073-fdf18c35717b]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:39 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 Feb 27 02:13:39 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:39 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5" returned: 0 in 0.479s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:39 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9731ef-00cc-4a31-9ddc-33f9c09b1bac]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:40 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 Feb 27 02:13:40 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:40 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5" returned: 0 in 0.451s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 /opt/stack/data/cinder/conversion/5fd8dc62-a515-4108-8551-9578ab6772f5.temp_image.2b11d54a-a342-4dec-9dca-2cc879714010bmyywcs9.img {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:40 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 /opt/stack/data/cinder/conversion/5fd8dc62-a515-4108-8551-9578ab6772f5.temp_image.2b11d54a-a342-4dec-9dca-2cc879714010bmyywcs9.img Feb 27 02:13:40 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:42 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 /opt/stack/data/cinder/conversion/5fd8dc62-a515-4108-8551-9578ab6772f5.temp_image.2b11d54a-a342-4dec-9dca-2cc879714010bmyywcs9.img" returned: 0 in 2.007s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:42 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85a0d8b-50c2-4a26-84b6-661dda665386]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:42 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 Feb 27 02:13:42 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:43 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5" returned: 0 in 0.561s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:43 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5, size 1024.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/conversion/5fd8dc62-a515-4108-8551-9578ab6772f5.temp_image.2b11d54a-a342-4dec-9dca-2cc879714010bmyywcs9.img {{(pid=82738) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:13:43 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] Converted 1024.00 MB image at 509.82 MB/s Feb 27 02:13:43 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] 2b11d54a-a342-4dec-9dca-2cc879714010 was raw, converting to qcow2 {{(pid=82738) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Feb 27 02:13:43 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[587b07e2-0fa3-4db7-b8e7-bd95ef6f6dcf]: (4, 'raw') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5fd8dc62-a515-4108-8551-9578ab6772f5.temp_image.2b11d54a-a342-4dec-9dca-2cc879714010bmyywcs9.img {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:43 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5fd8dc62-a515-4108-8551-9578ab6772f5.temp_image.2b11d54a-a342-4dec-9dca-2cc879714010bmyywcs9.img Feb 27 02:13:43 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:43 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5fd8dc62-a515-4108-8551-9578ab6772f5.temp_image.2b11d54a-a342-4dec-9dca-2cc879714010bmyywcs9.img" returned: 0 in 0.451s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5fd8dc62-a515-4108-8551-9578ab6772f5.temp_image.2b11d54a-a342-4dec-9dca-2cc879714010bmyywcs9.img {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:43 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5fd8dc62-a515-4108-8551-9578ab6772f5.temp_image.2b11d54a-a342-4dec-9dca-2cc879714010bmyywcs9.img Feb 27 02:13:43 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:43 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5fd8dc62-a515-4108-8551-9578ab6772f5.temp_image.2b11d54a-a342-4dec-9dca-2cc879714010bmyywcs9.img" returned: 1 in 0.437s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5fd8dc62-a515-4108-8551-9578ab6772f5.temp_image.2b11d54a-a342-4dec-9dca-2cc879714010bmyywcs9.img' failed. Not Retrying. {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:13:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5fd8dc62-a515-4108-8551-9578ab6772f5.temp_image.2b11d54a-a342-4dec-9dca-2cc879714010bmyywcs9.img /opt/stack/data/cinder/conversion/vol_upload_brk6l220 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:43 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5fd8dc62-a515-4108-8551-9578ab6772f5.temp_image.2b11d54a-a342-4dec-9dca-2cc879714010bmyywcs9.img /opt/stack/data/cinder/conversion/vol_upload_brk6l220 Feb 27 02:13:43 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:44 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5fd8dc62-a515-4108-8551-9578ab6772f5.temp_image.2b11d54a-a342-4dec-9dca-2cc879714010bmyywcs9.img /opt/stack/data/cinder/conversion/vol_upload_brk6l220" returned: 0 in 0.409s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:44 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] Image conversion details: src /opt/stack/data/cinder/conversion/5fd8dc62-a515-4108-8551-9578ab6772f5.temp_image.2b11d54a-a342-4dec-9dca-2cc879714010bmyywcs9.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_brk6l220 {{(pid=82738) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:13:44 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] Converted 1024.00 MB image at 1024.00 MB/s Feb 27 02:13:44 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f11944-7c37-43c8-b8e6-c069132cff25]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_brk6l220 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:44 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_brk6l220 Feb 27 02:13:44 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:44 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_brk6l220" returned: 0 in 0.458s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.158s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:45 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] Uploaded volume to glance image-id: 2b11d54a-a342-4dec-9dca-2cc879714010. {{(pid=82738) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 27 02:13:45 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-3161854f-80b3-48c9-863a-1cf21d48fbde tempest-VolumesActionsTest-132791294 None] Copy volume to image completed successfully. Feb 27 02:13:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-210a4167-950a-40f6-9595-666eba4bcc31 tempest-VolumesActionsTest-132791294 None] Acquiring lock "cinder-5fd8dc62-a515-4108-8551-9578ab6772f5-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-210a4167-950a-40f6-9595-666eba4bcc31 tempest-VolumesActionsTest-132791294 None] Lock "cinder-5fd8dc62-a515-4108-8551-9578ab6772f5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-210a4167-950a-40f6-9595-666eba4bcc31 tempest-VolumesActionsTest-132791294 None] Acquiring lock "cinder-quobyte-5fd8dc62-a515-4108-8551-9578ab6772f5" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-210a4167-950a-40f6-9595-666eba4bcc31 tempest-VolumesActionsTest-132791294 None] Lock "cinder-quobyte-5fd8dc62-a515-4108-8551-9578ab6772f5" acquired by "delete_volume" :: waited 0.008s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:47 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[857df0cc-8f5a-4b72-835c-24ff1cebbd97]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-210a4167-950a-40f6-9595-666eba4bcc31 tempest-VolumesActionsTest-132791294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:47 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 Feb 27 02:13:47 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:47 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-210a4167-950a-40f6-9595-666eba4bcc31 tempest-VolumesActionsTest-132791294 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5" returned: 0 in 0.461s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-210a4167-950a-40f6-9595-666eba4bcc31 tempest-VolumesActionsTest-132791294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:47 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5 Feb 27 02:13:47 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:48 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-210a4167-950a-40f6-9595-666eba4bcc31 tempest-VolumesActionsTest-132791294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-5fd8dc62-a515-4108-8551-9578ab6772f5" returned: 0 in 0.388s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:48 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-210a4167-950a-40f6-9595-666eba4bcc31 tempest-VolumesActionsTest-132791294 None] Lock "cinder-quobyte-5fd8dc62-a515-4108-8551-9578ab6772f5" released by "delete_volume" :: held 0.873s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:48 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-210a4167-950a-40f6-9595-666eba4bcc31 tempest-VolumesActionsTest-132791294 None] Created reservations ['72ee028a-c2ba-4260-8e79-4bb36c627516', 'b3afafdc-2c95-4a3d-83a9-5f728725b916', 'a9149da4-f865-4833-8982-04ec970e4ee3', '36ae1ad9-b2ee-472c-9519-2adb9c0c8c29'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:13:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-210a4167-950a-40f6-9595-666eba4bcc31 tempest-VolumesActionsTest-132791294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-210a4167-950a-40f6-9595-666eba4bcc31 tempest-VolumesActionsTest-132791294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:48 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-210a4167-950a-40f6-9595-666eba4bcc31 tempest-VolumesActionsTest-132791294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:48 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-210a4167-950a-40f6-9595-666eba4bcc31 tempest-VolumesActionsTest-132791294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-210a4167-950a-40f6-9595-666eba4bcc31 tempest-VolumesActionsTest-132791294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-210a4167-950a-40f6-9595-666eba4bcc31 tempest-VolumesActionsTest-132791294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:48 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:13:48 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:48 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-210a4167-950a-40f6-9595-666eba4bcc31 tempest-VolumesActionsTest-132791294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.410s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:48 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-210a4167-950a-40f6-9595-666eba4bcc31 tempest-VolumesActionsTest-132791294 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:13:48 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-210a4167-950a-40f6-9595-666eba4bcc31 tempest-VolumesActionsTest-132791294 None] Deleted volume successfully. Feb 27 02:13:48 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-210a4167-950a-40f6-9595-666eba4bcc31 tempest-VolumesActionsTest-132791294 None] Lock "cinder-5fd8dc62-a515-4108-8551-9578ab6772f5-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Flow 'volume_create_manager' (cb5d2d00-7c59-4897-b77c-c532c3b735d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fd6872-606e-4cdb-a2f6-41d6791cd078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fd6872-606e-4cdb-a2f6-41d6791cd078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1372181964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e165fa2-fc07-4e44-b770-b60df8e8045c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d184d3e15b45d68b5b5025e897f299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:53Z,use_quota=True,user_id='d3d309eed560497086140a53a40d2909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (446be01a-6ec2-495a-9be7-e7bb7a62f178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (446be01a-6ec2-495a-9be7-e7bb7a62f178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2cafa6b-ad07-41d1-b359-0346010cd77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2cafa6b-ad07-41d1-b359-0346010cd77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e165fa2-fc07-4e44-b770-b60df8e8045c', 'volume_name': 'volume-0e165fa2-fc07-4e44-b770-b60df8e8045c', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da4835db-4e39-45f9-8486-28b0d7848ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da4835db-4e39-45f9-8486-28b0d7848ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37b077e-b03c-438a-bf56-e096d0a7ab32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Volume 0e165fa2-fc07-4e44-b770-b60df8e8045c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e165fa2-fc07-4e44-b770-b60df8e8045c', 'volume_size': 1} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1372181964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e165fa2-fc07-4e44-b770-b60df8e8045c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d184d3e15b45d68b5b5025e897f299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:53Z,use_quota=True,user_id='d3d309eed560497086140a53a40d2909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Creating volume 0e165fa2-fc07-4e44-b770-b60df8e8045c {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:13:52 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0e165fa2-fc07-4e44-b770-b60df8e8045c 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:52 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0e165fa2-fc07-4e44-b770-b60df8e8045c 1073741824 Feb 27 02:13:52 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Flow 'volume_create_manager' (25affc78-25d9-445c-9071-9a9db577ad09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29587e07-c840-41be-8714-8fdaf5309a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29587e07-c840-41be-8714-8fdaf5309a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2007433246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44f9670-9b72-4357-9857-c97783ac7d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d184d3e15b45d68b5b5025e897f299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:53Z,use_quota=True,user_id='d3d309eed560497086140a53a40d2909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92eedd14-c78c-4418-988c-7a1549a5677c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92eedd14-c78c-4418-988c-7a1549a5677c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6dae830-4d66-438f-bd1c-e16b345243c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6dae830-4d66-438f-bd1c-e16b345243c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a44f9670-9b72-4357-9857-c97783ac7d0f', 'volume_name': 'volume-a44f9670-9b72-4357-9857-c97783ac7d0f', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c466ca-53a4-4dd4-a60c-7def1dd1c886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c466ca-53a4-4dd4-a60c-7def1dd1c886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf6b0ce-7167-4f84-ac2c-c6cf6f65d30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Volume a44f9670-9b72-4357-9857-c97783ac7d0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a44f9670-9b72-4357-9857-c97783ac7d0f', 'volume_size': 1} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Flow 'volume_create_manager' (063286a3-9249-420b-ae5a-3e2bc37ede1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1fe1d49-60bf-4af0-8932-3daf934f83c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1fe1d49-60bf-4af0-8932-3daf934f83c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-555461671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce872d7-9471-4498-b56c-a26abde694f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d184d3e15b45d68b5b5025e897f299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:53Z,use_quota=True,user_id='d3d309eed560497086140a53a40d2909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8048e6f3-985a-40c4-b03c-e4ad182d968f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8048e6f3-985a-40c4-b03c-e4ad182d968f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a6112b-26bb-46e3-804c-dbbb38cb25a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a6112b-26bb-46e3-804c-dbbb38cb25a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce872d7-9471-4498-b56c-a26abde694f4', 'volume_name': 'volume-8ce872d7-9471-4498-b56c-a26abde694f4', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4afbc0d-7e4e-4488-aa39-8caef99db5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4afbc0d-7e4e-4488-aa39-8caef99db5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (295ad23d-00ac-495b-a695-a0d83d8af783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Volume 8ce872d7-9471-4498-b56c-a26abde694f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce872d7-9471-4498-b56c-a26abde694f4', 'volume_size': 1} Feb 27 02:13:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:53 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Flow 'volume_create_manager' (b3412c6b-3564-4d05-b83c-3789567d5b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf8affe-b6f5-42c2-9d27-76c3144f2da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0e165fa2-fc07-4e44-b770-b60df8e8045c 1073741824" returned: 0 in 0.595s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf8affe-b6f5-42c2-9d27-76c3144f2da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1810022174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c64ba22-f8e2-4dce-a2b8-65f066645b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d184d3e15b45d68b5b5025e897f299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:53Z,use_quota=True,user_id='d3d309eed560497086140a53a40d2909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15564e6f-6379-4f08-be58-1c1d44f6b080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15564e6f-6379-4f08-be58-1c1d44f6b080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3079c642-cf94-480a-878b-f4dfc9b50088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3079c642-cf94-480a-878b-f4dfc9b50088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c64ba22-f8e2-4dce-a2b8-65f066645b78', 'volume_name': 'volume-1c64ba22-f8e2-4dce-a2b8-65f066645b78', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d8e9d7-774e-46d1-9bfc-e59faa68e587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d8e9d7-774e-46d1-9bfc-e59faa68e587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1113523-691c-4c35-8672-db15bfc40730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:53 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Volume 1c64ba22-f8e2-4dce-a2b8-65f066645b78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c64ba22-f8e2-4dce-a2b8-65f066645b78', 'volume_size': 1} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0e165fa2-fc07-4e44-b770-b60df8e8045c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:53 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0e165fa2-fc07-4e44-b770-b60df8e8045c Feb 27 02:13:53 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Flow 'volume_create_manager' (c1a788d8-3187-4599-96df-6f057bfc878d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f04391-1399-4043-8904-ac6a6a29b3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f04391-1399-4043-8904-ac6a6a29b3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-368663243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d74013b-ab6c-4cc6-84f2-9660a6be5d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d184d3e15b45d68b5b5025e897f299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:53Z,use_quota=True,user_id='d3d309eed560497086140a53a40d2909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69382dc-95cf-42b2-a1e2-50d9978335b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69382dc-95cf-42b2-a1e2-50d9978335b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5853a240-7b76-4096-a73e-76d9f7ba7430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5853a240-7b76-4096-a73e-76d9f7ba7430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d74013b-ab6c-4cc6-84f2-9660a6be5d5c', 'volume_name': 'volume-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105172a4-8e83-4ae1-b20b-fbbbd2b7b4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105172a4-8e83-4ae1-b20b-fbbbd2b7b4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74927777-5801-478b-a010-fcfb5881a313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:53 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Volume 4d74013b-ab6c-4cc6-84f2-9660a6be5d5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c', 'volume_size': 1} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:53 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0e165fa2-fc07-4e44-b770-b60df8e8045c" returned: 0 in 0.427s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.881s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2007433246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44f9670-9b72-4357-9857-c97783ac7d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d184d3e15b45d68b5b5025e897f299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:53Z,use_quota=True,user_id='d3d309eed560497086140a53a40d2909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Creating volume a44f9670-9b72-4357-9857-c97783ac7d0f {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:13:53 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a44f9670-9b72-4357-9857-c97783ac7d0f 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37b077e-b03c-438a-bf56-e096d0a7ab32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e165fa2-fc07-4e44-b770-b60df8e8045c', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:53 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a44f9670-9b72-4357-9857-c97783ac7d0f 1073741824 Feb 27 02:13:53 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ff3b7c-f1e3-449d-a97a-a184a59bdf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:53 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Volume volume-0e165fa2-fc07-4e44-b770-b60df8e8045c (0e165fa2-fc07-4e44-b770-b60df8e8045c): created successfully Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ff3b7c-f1e3-449d-a97a-a184a59bdf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Flow 'volume_create_manager' (cb5d2d00-7c59-4897-b77c-c532c3b735d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:53 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-9e20e0c1-3e1a-4533-ba21-3b1f1c6772e6 tempest-CreateVolumesFromImageTest-2064458343 None] Created volume successfully. Feb 27 02:13:54 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a44f9670-9b72-4357-9857-c97783ac7d0f 1073741824" returned: 0 in 0.477s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a44f9670-9b72-4357-9857-c97783ac7d0f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:54 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a44f9670-9b72-4357-9857-c97783ac7d0f Feb 27 02:13:54 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:54 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a44f9670-9b72-4357-9857-c97783ac7d0f" returned: 0 in 0.406s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:13:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.622s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-555461671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce872d7-9471-4498-b56c-a26abde694f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d184d3e15b45d68b5b5025e897f299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:53Z,use_quota=True,user_id='d3d309eed560497086140a53a40d2909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:13:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Creating volume 8ce872d7-9471-4498-b56c-a26abde694f4 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:13:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:13:54 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:13:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8ce872d7-9471-4498-b56c-a26abde694f4 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:54 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8ce872d7-9471-4498-b56c-a26abde694f4 1073741824 Feb 27 02:13:54 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf6b0ce-7167-4f84-ac2c-c6cf6f65d30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a44f9670-9b72-4357-9857-c97783ac7d0f', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0da481c-4147-4cdf-b65a-3b8406d82109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:54 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Volume volume-a44f9670-9b72-4357-9857-c97783ac7d0f (a44f9670-9b72-4357-9857-c97783ac7d0f): created successfully Feb 27 02:13:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0da481c-4147-4cdf-b65a-3b8406d82109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Flow 'volume_create_manager' (25affc78-25d9-445c-9071-9a9db577ad09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:54 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-f3b7128f-cbed-4c1c-a92c-62b8c540b3fd tempest-CreateVolumesFromImageTest-2064458343 None] Created volume successfully. Feb 27 02:13:55 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8ce872d7-9471-4498-b56c-a26abde694f4 1073741824" returned: 0 in 0.462s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8ce872d7-9471-4498-b56c-a26abde694f4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:55 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8ce872d7-9471-4498-b56c-a26abde694f4 Feb 27 02:13:55 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:55 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8ce872d7-9471-4498-b56c-a26abde694f4" returned: 0 in 0.410s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.273s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1810022174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c64ba22-f8e2-4dce-a2b8-65f066645b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d184d3e15b45d68b5b5025e897f299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:53Z,use_quota=True,user_id='d3d309eed560497086140a53a40d2909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Creating volume 1c64ba22-f8e2-4dce-a2b8-65f066645b78 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:13:55 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1c64ba22-f8e2-4dce-a2b8-65f066645b78 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:55 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1c64ba22-f8e2-4dce-a2b8-65f066645b78 1073741824 Feb 27 02:13:55 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (295ad23d-00ac-495b-a695-a0d83d8af783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce872d7-9471-4498-b56c-a26abde694f4', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36e1860-c71e-43d2-b465-8702fc946ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Volume volume-8ce872d7-9471-4498-b56c-a26abde694f4 (8ce872d7-9471-4498-b56c-a26abde694f4): created successfully Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36e1860-c71e-43d2-b465-8702fc946ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Flow 'volume_create_manager' (063286a3-9249-420b-ae5a-3e2bc37ede1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:55 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-25f01378-c2b5-4568-b6fd-d8a8060a6756 tempest-CreateVolumesFromImageTest-2064458343 None] Created volume successfully. Feb 27 02:13:55 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1c64ba22-f8e2-4dce-a2b8-65f066645b78 1073741824" returned: 0 in 0.451s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1c64ba22-f8e2-4dce-a2b8-65f066645b78 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:55 devstack sudo[89969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1c64ba22-f8e2-4dce-a2b8-65f066645b78 Feb 27 02:13:55 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:56 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1c64ba22-f8e2-4dce-a2b8-65f066645b78" returned: 0 in 0.389s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:13:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.926s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-368663243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d74013b-ab6c-4cc6-84f2-9660a6be5d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d184d3e15b45d68b5b5025e897f299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:53Z,use_quota=True,user_id='d3d309eed560497086140a53a40d2909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:13:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Creating volume 4d74013b-ab6c-4cc6-84f2-9660a6be5d5c {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:13:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:13:56 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:13:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1113523-691c-4c35-8672-db15bfc40730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c64ba22-f8e2-4dce-a2b8-65f066645b78', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99bbeea9-22a8-4137-adf3-95198899786b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:56 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c 1073741824 Feb 27 02:13:56 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:56 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Volume volume-1c64ba22-f8e2-4dce-a2b8-65f066645b78 (1c64ba22-f8e2-4dce-a2b8-65f066645b78): created successfully Feb 27 02:13:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99bbeea9-22a8-4137-adf3-95198899786b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Flow 'volume_create_manager' (b3412c6b-3564-4d05-b83c-3789567d5b26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:56 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-f5c92d33-121c-42b7-91a4-f69bb834c3f0 tempest-CreateVolumesFromImageTest-2064458343 None] Created volume successfully. Feb 27 02:13:56 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c 1073741824" returned: 0 in 0.456s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:56 devstack sudo[89977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c Feb 27 02:13:56 devstack sudo[89977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:57 devstack sudo[89977]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c" returned: 0 in 0.390s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:57 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:13:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74927777-5801-478b-a010-fcfb5881a313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0817809-964d-488e-a578-42c864e122c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:57 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Volume volume-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c (4d74013b-ab6c-4cc6-84f2-9660a6be5d5c): created successfully Feb 27 02:13:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0817809-964d-488e-a578-42c864e122c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Flow 'volume_create_manager' (c1a788d8-3187-4599-96df-6f057bfc878d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:57 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-aba4ca3a-9cb5-4deb-ad9b-c7fae8380d3f tempest-CreateVolumesFromImageTest-2064458343 None] Created volume successfully. Feb 27 02:13:57 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1e2335c-6da1-41aa-b9e3-d42bcb79d0c6 tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "cinder-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:57 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1e2335c-6da1-41aa-b9e3-d42bcb79d0c6 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "cinder-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:57 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1e2335c-6da1-41aa-b9e3-d42bcb79d0c6 tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "cinder-quobyte-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:57 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1e2335c-6da1-41aa-b9e3-d42bcb79d0c6 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "cinder-quobyte-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:57 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e8b903-1ab3-4ad6-b1af-dc97019b327a]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a1e2335c-6da1-41aa-b9e3-d42bcb79d0c6 tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:57 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c Feb 27 02:13:57 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:58 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a1e2335c-6da1-41aa-b9e3-d42bcb79d0c6 tempest-CreateVolumesFromImageTest-2064458343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c" returned: 0 in 0.476s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a1e2335c-6da1-41aa-b9e3-d42bcb79d0c6 tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:58 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c Feb 27 02:13:58 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:58 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a1e2335c-6da1-41aa-b9e3-d42bcb79d0c6 tempest-CreateVolumesFromImageTest-2064458343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c" returned: 0 in 0.397s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:58 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1e2335c-6da1-41aa-b9e3-d42bcb79d0c6 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "cinder-quobyte-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c" released by "delete_volume" :: held 0.903s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:58 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-a1e2335c-6da1-41aa-b9e3-d42bcb79d0c6 tempest-CreateVolumesFromImageTest-2064458343 None] Created reservations ['e28eb3f5-f991-42c8-ad5b-c8c3ae0b88da', 'd7d9edeb-666e-4404-b6a5-3db7148175cf', 'e9068bf9-0f6c-4d64-9b00-5af8f13873bd', '7726f304-6f73-4453-930f-7883b5b3aa9b'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:13:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a1e2335c-6da1-41aa-b9e3-d42bcb79d0c6 tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a1e2335c-6da1-41aa-b9e3-d42bcb79d0c6 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:58 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-a1e2335c-6da1-41aa-b9e3-d42bcb79d0c6 tempest-CreateVolumesFromImageTest-2064458343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:58 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-a1e2335c-6da1-41aa-b9e3-d42bcb79d0c6 tempest-CreateVolumesFromImageTest-2064458343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a1e2335c-6da1-41aa-b9e3-d42bcb79d0c6 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a1e2335c-6da1-41aa-b9e3-d42bcb79d0c6 tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:58 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:13:58 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:58 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b066b011-111c-4646-88fc-42e4b68fe9de tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "cinder-1c64ba22-f8e2-4dce-a2b8-65f066645b78-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:58 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b066b011-111c-4646-88fc-42e4b68fe9de tempest-CreateVolumesFromImageTest-2064458343 None] Lock "cinder-1c64ba22-f8e2-4dce-a2b8-65f066645b78-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:58 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b066b011-111c-4646-88fc-42e4b68fe9de tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "cinder-quobyte-1c64ba22-f8e2-4dce-a2b8-65f066645b78" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:58 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b066b011-111c-4646-88fc-42e4b68fe9de tempest-CreateVolumesFromImageTest-2064458343 None] Lock "cinder-quobyte-1c64ba22-f8e2-4dce-a2b8-65f066645b78" acquired by "delete_volume" :: waited 0.015s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:58 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3f54a3-336d-4542-bb4b-9e2ea6cd6349]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b066b011-111c-4646-88fc-42e4b68fe9de tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1c64ba22-f8e2-4dce-a2b8-65f066645b78 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:59 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1c64ba22-f8e2-4dce-a2b8-65f066645b78 Feb 27 02:13:59 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:59 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a1e2335c-6da1-41aa-b9e3-d42bcb79d0c6 tempest-CreateVolumesFromImageTest-2064458343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.415s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:59 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-a1e2335c-6da1-41aa-b9e3-d42bcb79d0c6 tempest-CreateVolumesFromImageTest-2064458343 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:13:59 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-a1e2335c-6da1-41aa-b9e3-d42bcb79d0c6 tempest-CreateVolumesFromImageTest-2064458343 None] Deleted volume successfully. Feb 27 02:13:59 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1e2335c-6da1-41aa-b9e3-d42bcb79d0c6 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "cinder-4d74013b-ab6c-4cc6-84f2-9660a6be5d5c-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:59 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b066b011-111c-4646-88fc-42e4b68fe9de tempest-CreateVolumesFromImageTest-2064458343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1c64ba22-f8e2-4dce-a2b8-65f066645b78" returned: 0 in 0.483s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b066b011-111c-4646-88fc-42e4b68fe9de tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1c64ba22-f8e2-4dce-a2b8-65f066645b78 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:59 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1c64ba22-f8e2-4dce-a2b8-65f066645b78 Feb 27 02:13:59 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:59 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b066b011-111c-4646-88fc-42e4b68fe9de tempest-CreateVolumesFromImageTest-2064458343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1c64ba22-f8e2-4dce-a2b8-65f066645b78" returned: 0 in 0.400s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:59 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b066b011-111c-4646-88fc-42e4b68fe9de tempest-CreateVolumesFromImageTest-2064458343 None] Lock "cinder-quobyte-1c64ba22-f8e2-4dce-a2b8-65f066645b78" released by "delete_volume" :: held 0.904s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:59 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-b066b011-111c-4646-88fc-42e4b68fe9de tempest-CreateVolumesFromImageTest-2064458343 None] Created reservations ['4d270638-27fc-44de-a371-0719703d04fa', '0a1e9e7a-93f5-4a1c-9a8c-20e00cad02d4', '07d19b2c-2b4b-4ff9-80c9-26176f75bff9', '0838acd1-bbfd-4afa-96b4-44b43a1bc966'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:13:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b066b011-111c-4646-88fc-42e4b68fe9de tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b066b011-111c-4646-88fc-42e4b68fe9de tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b066b011-111c-4646-88fc-42e4b68fe9de tempest-CreateVolumesFromImageTest-2064458343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:59 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b066b011-111c-4646-88fc-42e4b68fe9de tempest-CreateVolumesFromImageTest-2064458343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b066b011-111c-4646-88fc-42e4b68fe9de tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b066b011-111c-4646-88fc-42e4b68fe9de tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:59 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:13:59 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-63215d01-b97d-4008-8d20-d25c024fa3b3 tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "cinder-8ce872d7-9471-4498-b56c-a26abde694f4-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-63215d01-b97d-4008-8d20-d25c024fa3b3 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "cinder-8ce872d7-9471-4498-b56c-a26abde694f4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-63215d01-b97d-4008-8d20-d25c024fa3b3 tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "cinder-quobyte-8ce872d7-9471-4498-b56c-a26abde694f4" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-63215d01-b97d-4008-8d20-d25c024fa3b3 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "cinder-quobyte-8ce872d7-9471-4498-b56c-a26abde694f4" acquired by "delete_volume" :: waited 0.008s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:00 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e8481a-a587-494a-82cf-6eb672275818]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-63215d01-b97d-4008-8d20-d25c024fa3b3 tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8ce872d7-9471-4498-b56c-a26abde694f4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:00 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8ce872d7-9471-4498-b56c-a26abde694f4 Feb 27 02:14:00 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:00 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b066b011-111c-4646-88fc-42e4b68fe9de tempest-CreateVolumesFromImageTest-2064458343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.399s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:00 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-b066b011-111c-4646-88fc-42e4b68fe9de tempest-CreateVolumesFromImageTest-2064458343 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:00 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-b066b011-111c-4646-88fc-42e4b68fe9de tempest-CreateVolumesFromImageTest-2064458343 None] Deleted volume successfully. Feb 27 02:14:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b066b011-111c-4646-88fc-42e4b68fe9de tempest-CreateVolumesFromImageTest-2064458343 None] Lock "cinder-1c64ba22-f8e2-4dce-a2b8-65f066645b78-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:00 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-63215d01-b97d-4008-8d20-d25c024fa3b3 tempest-CreateVolumesFromImageTest-2064458343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8ce872d7-9471-4498-b56c-a26abde694f4" returned: 0 in 0.484s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-63215d01-b97d-4008-8d20-d25c024fa3b3 tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8ce872d7-9471-4498-b56c-a26abde694f4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:00 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8ce872d7-9471-4498-b56c-a26abde694f4 Feb 27 02:14:00 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:00 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-63215d01-b97d-4008-8d20-d25c024fa3b3 tempest-CreateVolumesFromImageTest-2064458343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8ce872d7-9471-4498-b56c-a26abde694f4" returned: 0 in 0.390s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-63215d01-b97d-4008-8d20-d25c024fa3b3 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "cinder-quobyte-8ce872d7-9471-4498-b56c-a26abde694f4" released by "delete_volume" :: held 0.897s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:01 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-63215d01-b97d-4008-8d20-d25c024fa3b3 tempest-CreateVolumesFromImageTest-2064458343 None] Created reservations ['9f5c9cd0-251e-47be-b482-617f80c417c2', '45cf6ebc-1ce4-4cf3-a300-c71dd9f41f26', '94532b11-76bc-4fb0-b26d-59add013ca33', '151c3b01-39b3-4cbb-9e0a-7c5f3b6e4f29'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-63215d01-b97d-4008-8d20-d25c024fa3b3 tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-63215d01-b97d-4008-8d20-d25c024fa3b3 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-63215d01-b97d-4008-8d20-d25c024fa3b3 tempest-CreateVolumesFromImageTest-2064458343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-63215d01-b97d-4008-8d20-d25c024fa3b3 tempest-CreateVolumesFromImageTest-2064458343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-63215d01-b97d-4008-8d20-d25c024fa3b3 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-63215d01-b97d-4008-8d20-d25c024fa3b3 tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:01 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:14:01 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:01 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f5f053a1-919f-499c-9984-65342e0d6cfd tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "cinder-a44f9670-9b72-4357-9857-c97783ac7d0f-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:01 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f5f053a1-919f-499c-9984-65342e0d6cfd tempest-CreateVolumesFromImageTest-2064458343 None] Lock "cinder-a44f9670-9b72-4357-9857-c97783ac7d0f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:01 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f5f053a1-919f-499c-9984-65342e0d6cfd tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "cinder-quobyte-a44f9670-9b72-4357-9857-c97783ac7d0f" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:01 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f5f053a1-919f-499c-9984-65342e0d6cfd tempest-CreateVolumesFromImageTest-2064458343 None] Lock "cinder-quobyte-a44f9670-9b72-4357-9857-c97783ac7d0f" acquired by "delete_volume" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:01 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61b465d-b2d9-4d4e-93e8-aa9b81a4abba]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5f053a1-919f-499c-9984-65342e0d6cfd tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a44f9670-9b72-4357-9857-c97783ac7d0f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:01 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a44f9670-9b72-4357-9857-c97783ac7d0f Feb 27 02:14:01 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:01 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-63215d01-b97d-4008-8d20-d25c024fa3b3 tempest-CreateVolumesFromImageTest-2064458343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.417s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:01 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-63215d01-b97d-4008-8d20-d25c024fa3b3 tempest-CreateVolumesFromImageTest-2064458343 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:01 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-63215d01-b97d-4008-8d20-d25c024fa3b3 tempest-CreateVolumesFromImageTest-2064458343 None] Deleted volume successfully. Feb 27 02:14:01 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-63215d01-b97d-4008-8d20-d25c024fa3b3 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "cinder-8ce872d7-9471-4498-b56c-a26abde694f4-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:01 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5f053a1-919f-499c-9984-65342e0d6cfd tempest-CreateVolumesFromImageTest-2064458343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a44f9670-9b72-4357-9857-c97783ac7d0f" returned: 0 in 0.469s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5f053a1-919f-499c-9984-65342e0d6cfd tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a44f9670-9b72-4357-9857-c97783ac7d0f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:01 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a44f9670-9b72-4357-9857-c97783ac7d0f Feb 27 02:14:01 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:02 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5f053a1-919f-499c-9984-65342e0d6cfd tempest-CreateVolumesFromImageTest-2064458343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a44f9670-9b72-4357-9857-c97783ac7d0f" returned: 0 in 0.385s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:02 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f5f053a1-919f-499c-9984-65342e0d6cfd tempest-CreateVolumesFromImageTest-2064458343 None] Lock "cinder-quobyte-a44f9670-9b72-4357-9857-c97783ac7d0f" released by "delete_volume" :: held 0.876s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:02 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-f5f053a1-919f-499c-9984-65342e0d6cfd tempest-CreateVolumesFromImageTest-2064458343 None] Created reservations ['67e5a45b-6c5e-410e-86a8-ad3b0d1b6619', 'e5e51e1c-b40f-46ea-a167-2f65bc15877e', 'e6a4f49c-fa32-4d7c-b3d7-6dd9cc9f0480', '099fa3f5-f17a-4823-828c-232c7780c0eb'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f5f053a1-919f-499c-9984-65342e0d6cfd tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f5f053a1-919f-499c-9984-65342e0d6cfd tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f5f053a1-919f-499c-9984-65342e0d6cfd tempest-CreateVolumesFromImageTest-2064458343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f5f053a1-919f-499c-9984-65342e0d6cfd tempest-CreateVolumesFromImageTest-2064458343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f5f053a1-919f-499c-9984-65342e0d6cfd tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5f053a1-919f-499c-9984-65342e0d6cfd tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:02 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:14:02 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:02 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-38482bbe-2a70-468d-b98e-ab1bbd3a1605 tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "cinder-0e165fa2-fc07-4e44-b770-b60df8e8045c-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:02 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-38482bbe-2a70-468d-b98e-ab1bbd3a1605 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "cinder-0e165fa2-fc07-4e44-b770-b60df8e8045c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:02 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-38482bbe-2a70-468d-b98e-ab1bbd3a1605 tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "cinder-quobyte-0e165fa2-fc07-4e44-b770-b60df8e8045c" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:02 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-38482bbe-2a70-468d-b98e-ab1bbd3a1605 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "cinder-quobyte-0e165fa2-fc07-4e44-b770-b60df8e8045c" acquired by "delete_volume" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:02 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84c488d-4026-4a12-bb22-06bf12fdf73b]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-38482bbe-2a70-468d-b98e-ab1bbd3a1605 tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0e165fa2-fc07-4e44-b770-b60df8e8045c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:02 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0e165fa2-fc07-4e44-b770-b60df8e8045c Feb 27 02:14:02 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:02 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f5f053a1-919f-499c-9984-65342e0d6cfd tempest-CreateVolumesFromImageTest-2064458343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.418s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:02 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-f5f053a1-919f-499c-9984-65342e0d6cfd tempest-CreateVolumesFromImageTest-2064458343 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:02 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-f5f053a1-919f-499c-9984-65342e0d6cfd tempest-CreateVolumesFromImageTest-2064458343 None] Deleted volume successfully. Feb 27 02:14:02 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f5f053a1-919f-499c-9984-65342e0d6cfd tempest-CreateVolumesFromImageTest-2064458343 None] Lock "cinder-a44f9670-9b72-4357-9857-c97783ac7d0f-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:02 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-38482bbe-2a70-468d-b98e-ab1bbd3a1605 tempest-CreateVolumesFromImageTest-2064458343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0e165fa2-fc07-4e44-b770-b60df8e8045c" returned: 0 in 0.494s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-38482bbe-2a70-468d-b98e-ab1bbd3a1605 tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0e165fa2-fc07-4e44-b770-b60df8e8045c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:02 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0e165fa2-fc07-4e44-b770-b60df8e8045c Feb 27 02:14:02 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:03 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-38482bbe-2a70-468d-b98e-ab1bbd3a1605 tempest-CreateVolumesFromImageTest-2064458343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-0e165fa2-fc07-4e44-b770-b60df8e8045c" returned: 0 in 0.426s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:03 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-38482bbe-2a70-468d-b98e-ab1bbd3a1605 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "cinder-quobyte-0e165fa2-fc07-4e44-b770-b60df8e8045c" released by "delete_volume" :: held 0.942s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:03 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-38482bbe-2a70-468d-b98e-ab1bbd3a1605 tempest-CreateVolumesFromImageTest-2064458343 None] Created reservations ['08cc7b88-63f9-43f2-8a69-a080600debf9', '303bc9dc-4cff-4fdf-b542-fb75d9d4b471', '5bda931b-091a-40d4-ad98-d786a1c674a6', '0a6b7df4-3616-4e3e-9e8d-3d1de65386ba'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-38482bbe-2a70-468d-b98e-ab1bbd3a1605 tempest-CreateVolumesFromImageTest-2064458343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-38482bbe-2a70-468d-b98e-ab1bbd3a1605 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-38482bbe-2a70-468d-b98e-ab1bbd3a1605 tempest-CreateVolumesFromImageTest-2064458343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-38482bbe-2a70-468d-b98e-ab1bbd3a1605 tempest-CreateVolumesFromImageTest-2064458343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-38482bbe-2a70-468d-b98e-ab1bbd3a1605 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-38482bbe-2a70-468d-b98e-ab1bbd3a1605 tempest-CreateVolumesFromImageTest-2064458343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:03 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:14:03 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:03 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-38482bbe-2a70-468d-b98e-ab1bbd3a1605 tempest-CreateVolumesFromImageTest-2064458343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.458s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:03 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-38482bbe-2a70-468d-b98e-ab1bbd3a1605 tempest-CreateVolumesFromImageTest-2064458343 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:03 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-38482bbe-2a70-468d-b98e-ab1bbd3a1605 tempest-CreateVolumesFromImageTest-2064458343 None] Deleted volume successfully. Feb 27 02:14:03 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-38482bbe-2a70-468d-b98e-ab1bbd3a1605 tempest-CreateVolumesFromImageTest-2064458343 None] Lock "cinder-0e165fa2-fc07-4e44-b770-b60df8e8045c-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Flow 'volume_create_manager' (193b22ae-178a-4cbd-a3b3-45d62a4bd54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5cba0b-41ec-47da-9986-96a0e59d62b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5cba0b-41ec-47da-9986-96a0e59d62b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1148124254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=055c84ff-7bf2-4ab4-a79f-9fe768a209ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='407d12b4a4f64e8abb478a9acbdba02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:05Z,use_quota=True,user_id='7d87ab1c27d44baba81d1dd2233447c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16669bb7-e9ff-4795-9a06-88ae360d58c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16669bb7-e9ff-4795-9a06-88ae360d58c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f1adb2-c9f5-4a98-b32e-da9b1c635dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f1adb2-c9f5-4a98-b32e-da9b1c635dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '055c84ff-7bf2-4ab4-a79f-9fe768a209ff', 'volume_name': 'volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f89486-60cf-4310-82c7-126ad89c435b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f89486-60cf-4310-82c7-126ad89c435b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae41dd1-126f-4f07-a518-0cefd404c28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:05 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Volume 055c84ff-7bf2-4ab4-a79f-9fe768a209ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff', 'volume_size': 1} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1148124254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=055c84ff-7bf2-4ab4-a79f-9fe768a209ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='407d12b4a4f64e8abb478a9acbdba02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:05Z,use_quota=True,user_id='7d87ab1c27d44baba81d1dd2233447c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Creating volume 055c84ff-7bf2-4ab4-a79f-9fe768a209ff {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:05 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:05 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff 1073741824 Feb 27 02:14:05 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:05 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff 1073741824" returned: 0 in 0.462s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:05 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:05 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff Feb 27 02:14:05 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:06 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff" returned: 0 in 0.381s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:06 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae41dd1-126f-4f07-a518-0cefd404c28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf225485-9e78-45d4-86d6-ef9118b723d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:06 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Volume volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff (055c84ff-7bf2-4ab4-a79f-9fe768a209ff): created successfully Feb 27 02:14:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf225485-9e78-45d4-86d6-ef9118b723d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:06 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Flow 'volume_create_manager' (193b22ae-178a-4cbd-a3b3-45d62a4bd54c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:06 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-fcc3da11-be5d-4cf1-aea4-a71a9e9a5b01 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Created volume successfully. Feb 27 02:14:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6ae45478-30b3-4ece-908a-233c7e7bc66f tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6ae45478-30b3-4ece-908a-233c7e7bc66f tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:06 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-6ae45478-30b3-4ece-908a-233c7e7bc66f tempest-CreateVolumesFromSnapshotTest-1848332629 None] Creating offline snapshot ac72c504-c29c-497a-9c03-31e27ccc5631 of volume 055c84ff-7bf2-4ab4-a79f-9fe768a209ff {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:14:06 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9e7518-773b-48fb-bb67-f40de157aae1]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6ae45478-30b3-4ece-908a-233c7e7bc66f tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:06 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff Feb 27 02:14:06 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:06 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6ae45478-30b3-4ece-908a-233c7e7bc66f tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff" returned: 0 in 0.451s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6ae45478-30b3-4ece-908a-233c7e7bc66f tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.ac72c504-c29c-497a-9c03-31e27ccc5631 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:06 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.ac72c504-c29c-497a-9c03-31e27ccc5631 1G Feb 27 02:14:06 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:07 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6ae45478-30b3-4ece-908a-233c7e7bc66f tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.ac72c504-c29c-497a-9c03-31e27ccc5631 1G" returned: 0 in 0.471s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6ae45478-30b3-4ece-908a-233c7e7bc66f tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.ac72c504-c29c-497a-9c03-31e27ccc5631 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:07 devstack sudo[90054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.ac72c504-c29c-497a-9c03-31e27ccc5631 Feb 27 02:14:07 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:07 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6ae45478-30b3-4ece-908a-233c7e7bc66f tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.ac72c504-c29c-497a-9c03-31e27ccc5631" returned: 0 in 0.422s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:07 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-6ae45478-30b3-4ece-908a-233c7e7bc66f tempest-CreateVolumesFromSnapshotTest-1848332629 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.ac72c504-c29c-497a-9c03-31e27ccc5631 is being set with open permissions: ugo+rw Feb 27 02:14:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6ae45478-30b3-4ece-908a-233c7e7bc66f tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.ac72c504-c29c-497a-9c03-31e27ccc5631 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:07 devstack sudo[90059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.ac72c504-c29c-497a-9c03-31e27ccc5631 Feb 27 02:14:07 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:08 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6ae45478-30b3-4ece-908a-233c7e7bc66f tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.ac72c504-c29c-497a-9c03-31e27ccc5631" returned: 0 in 0.407s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6ae45478-30b3-4ece-908a-233c7e7bc66f tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:08 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.info Feb 27 02:14:08 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:08 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6ae45478-30b3-4ece-908a-233c7e7bc66f tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.info" returned: 0 in 0.397s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:08 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-6ae45478-30b3-4ece-908a-233c7e7bc66f tempest-CreateVolumesFromSnapshotTest-1848332629 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.info is being set with open permissions: ugo+rw Feb 27 02:14:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6ae45478-30b3-4ece-908a-233c7e7bc66f tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:08 devstack sudo[90065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.info Feb 27 02:14:08 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:08 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6ae45478-30b3-4ece-908a-233c7e7bc66f tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.info" returned: 0 in 0.408s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6ae45478-30b3-4ece-908a-233c7e7bc66f tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.614s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:08 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-6ae45478-30b3-4ece-908a-233c7e7bc66f tempest-CreateVolumesFromSnapshotTest-1848332629 None] Create snapshot completed successfully Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Flow 'volume_create_manager' (5f889d8a-52f3-44b0-b929-fa231ce0a321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b217b456-686f-4c34-8efc-50b9901c1457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b217b456-686f-4c34-8efc-50b9901c1457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-181032432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c50218-df6c-415b-b0ec-b35d3a566655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='407d12b4a4f64e8abb478a9acbdba02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:10Z,use_quota=True,user_id='7d87ab1c27d44baba81d1dd2233447c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8d6867-2020-48a5-b874-9e5b37c7c929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8d6867-2020-48a5-b874-9e5b37c7c929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21936abd-d31a-4e79-8251-e985ae145865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21936abd-d31a-4e79-8251-e985ae145865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42c50218-df6c-415b-b0ec-b35d3a566655', 'volume_name': 'volume-42c50218-df6c-415b-b0ec-b35d3a566655', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e832935-0253-4a18-9d9c-21305d8809ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e832935-0253-4a18-9d9c-21305d8809ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298ebc95-13e6-4be0-8ace-b422db2de3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:09 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Volume 42c50218-df6c-415b-b0ec-b35d3a566655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42c50218-df6c-415b-b0ec-b35d3a566655', 'volume_size': 1} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-181032432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c50218-df6c-415b-b0ec-b35d3a566655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='407d12b4a4f64e8abb478a9acbdba02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:10Z,use_quota=True,user_id='7d87ab1c27d44baba81d1dd2233447c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Creating volume 42c50218-df6c-415b-b0ec-b35d3a566655 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:09 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-42c50218-df6c-415b-b0ec-b35d3a566655 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:09 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-42c50218-df6c-415b-b0ec-b35d3a566655 1073741824 Feb 27 02:14:09 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Flow 'volume_create_manager' (f9d94840-3af1-478e-a5cf-d63cc0f9eac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b959e1ac-1e5c-4cff-ae7a-2ea124546c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b959e1ac-1e5c-4cff-ae7a-2ea124546c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2047145609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fdd5b6a-b454-4db9-906b-30b8669f12e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='407d12b4a4f64e8abb478a9acbdba02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:10Z,use_quota=True,user_id='7d87ab1c27d44baba81d1dd2233447c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c8296d-7003-4b0d-a113-645d1d3c54a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c8296d-7003-4b0d-a113-645d1d3c54a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7a137d-ee52-4804-9798-aa99269d754a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7a137d-ee52-4804-9798-aa99269d754a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fdd5b6a-b454-4db9-906b-30b8669f12e9', 'volume_name': 'volume-4fdd5b6a-b454-4db9-906b-30b8669f12e9', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2634961-ac95-42ac-89e3-000c061eb19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2634961-ac95-42ac-89e3-000c061eb19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88df4fbc-3f90-4930-b9e1-94dcdeadfedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:09 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Volume 4fdd5b6a-b454-4db9-906b-30b8669f12e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fdd5b6a-b454-4db9-906b-30b8669f12e9', 'volume_size': 1} Feb 27 02:14:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Flow 'volume_create_manager' (92ab6457-d781-4292-ae7d-71da41c25d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf1eca9-6f66-483f-a053-cb011c1b9dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf1eca9-6f66-483f-a053-cb011c1b9dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-752481733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26567b38-6019-4206-bb04-fb4fc1cd9a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='407d12b4a4f64e8abb478a9acbdba02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:10Z,use_quota=True,user_id='7d87ab1c27d44baba81d1dd2233447c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc3b728-667e-47aa-88fe-edfce1a84a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc3b728-667e-47aa-88fe-edfce1a84a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25defc9b-50a4-47b8-b6b8-33e423a97db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25defc9b-50a4-47b8-b6b8-33e423a97db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26567b38-6019-4206-bb04-fb4fc1cd9a85', 'volume_name': 'volume-26567b38-6019-4206-bb04-fb4fc1cd9a85', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6335889b-54ed-495b-8e47-3f957f0e34e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6335889b-54ed-495b-8e47-3f957f0e34e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed20a0a-02c3-43ff-94a0-5ab1a0508653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:10 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Volume 26567b38-6019-4206-bb04-fb4fc1cd9a85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26567b38-6019-4206-bb04-fb4fc1cd9a85', 'volume_size': 1} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:10 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-42c50218-df6c-415b-b0ec-b35d3a566655 1073741824" returned: 0 in 0.562s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-42c50218-df6c-415b-b0ec-b35d3a566655 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:10 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-42c50218-df6c-415b-b0ec-b35d3a566655 Feb 27 02:14:10 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Flow 'volume_create_manager' (1cd3878c-4b8c-40eb-8c15-b88c2919516f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea9379e-523e-4f78-a73b-27a1da9c1eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea9379e-523e-4f78-a73b-27a1da9c1eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-883756699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba38657e-747f-4120-b26f-e85bcf85d57f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='407d12b4a4f64e8abb478a9acbdba02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:10Z,use_quota=True,user_id='7d87ab1c27d44baba81d1dd2233447c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33349c5e-0b05-4636-bd56-223af7554fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33349c5e-0b05-4636-bd56-223af7554fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0270e4b-6238-4851-b31a-a3f0af56ced4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0270e4b-6238-4851-b31a-a3f0af56ced4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba38657e-747f-4120-b26f-e85bcf85d57f', 'volume_name': 'volume-ba38657e-747f-4120-b26f-e85bcf85d57f', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7182246f-d6cb-4834-8c25-0d8b5490e5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7182246f-d6cb-4834-8c25-0d8b5490e5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26332db1-2ade-48c5-af23-6c855d199a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:10 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Volume ba38657e-747f-4120-b26f-e85bcf85d57f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba38657e-747f-4120-b26f-e85bcf85d57f', 'volume_size': 1} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Flow 'volume_create_manager' (d456f1ff-b8d6-4b56-b97a-2e20f8bbb8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6a7cc1-edc0-4dd0-b4de-cbee8a9b6aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6a7cc1-edc0-4dd0-b4de-cbee8a9b6aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2048881831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c336dbc0-8530-4adf-b819-e12f528d35e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='407d12b4a4f64e8abb478a9acbdba02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:10Z,use_quota=True,user_id='7d87ab1c27d44baba81d1dd2233447c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d03c7b6-9f00-4525-8956-2f2348209509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d03c7b6-9f00-4525-8956-2f2348209509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de73f6fb-c55a-43ac-8738-c7cb16f558bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de73f6fb-c55a-43ac-8738-c7cb16f558bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c336dbc0-8530-4adf-b819-e12f528d35e8', 'volume_name': 'volume-c336dbc0-8530-4adf-b819-e12f528d35e8', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71a6254-d2d0-4ab6-b1db-eaf6d4532d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71a6254-d2d0-4ab6-b1db-eaf6d4532d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb95b5c-5245-4682-9a67-ce5e385930dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:10 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Volume c336dbc0-8530-4adf-b819-e12f528d35e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c336dbc0-8530-4adf-b819-e12f528d35e8', 'volume_size': 1} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:10 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-42c50218-df6c-415b-b0ec-b35d3a566655" returned: 0 in 0.540s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.929s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2047145609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fdd5b6a-b454-4db9-906b-30b8669f12e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='407d12b4a4f64e8abb478a9acbdba02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:10Z,use_quota=True,user_id='7d87ab1c27d44baba81d1dd2233447c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Creating volume 4fdd5b6a-b454-4db9-906b-30b8669f12e9 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:10 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4fdd5b6a-b454-4db9-906b-30b8669f12e9 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:10 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4fdd5b6a-b454-4db9-906b-30b8669f12e9 1073741824 Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298ebc95-13e6-4be0-8ace-b422db2de3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42c50218-df6c-415b-b0ec-b35d3a566655', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:10 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6884a095-cad3-4615-8df5-177f0c4e6f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:10 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Volume volume-42c50218-df6c-415b-b0ec-b35d3a566655 (42c50218-df6c-415b-b0ec-b35d3a566655): created successfully Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6884a095-cad3-4615-8df5-177f0c4e6f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Flow 'volume_create_manager' (5f889d8a-52f3-44b0-b929-fa231ce0a321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:10 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e3c44f08-ec5a-450d-860f-bd667d6680ee tempest-CreateVolumesFromSnapshotTest-1848332629 None] Created volume successfully. Feb 27 02:14:11 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4fdd5b6a-b454-4db9-906b-30b8669f12e9 1073741824" returned: 0 in 0.486s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4fdd5b6a-b454-4db9-906b-30b8669f12e9 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:11 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4fdd5b6a-b454-4db9-906b-30b8669f12e9 Feb 27 02:14:11 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:11 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4fdd5b6a-b454-4db9-906b-30b8669f12e9" returned: 0 in 0.456s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.686s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-752481733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26567b38-6019-4206-bb04-fb4fc1cd9a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='407d12b4a4f64e8abb478a9acbdba02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:10Z,use_quota=True,user_id='7d87ab1c27d44baba81d1dd2233447c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Creating volume 26567b38-6019-4206-bb04-fb4fc1cd9a85 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:11 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:14:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-26567b38-6019-4206-bb04-fb4fc1cd9a85 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88df4fbc-3f90-4930-b9e1-94dcdeadfedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fdd5b6a-b454-4db9-906b-30b8669f12e9', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:11 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-26567b38-6019-4206-bb04-fb4fc1cd9a85 1073741824 Feb 27 02:14:11 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c936dc2-62d8-4e4c-bb79-4420714b2a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:11 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Volume volume-4fdd5b6a-b454-4db9-906b-30b8669f12e9 (4fdd5b6a-b454-4db9-906b-30b8669f12e9): created successfully Feb 27 02:14:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c936dc2-62d8-4e4c-bb79-4420714b2a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Flow 'volume_create_manager' (f9d94840-3af1-478e-a5cf-d63cc0f9eac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:11 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-7a6d5c93-0a6c-49ad-97c4-95476160ee32 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Created volume successfully. Feb 27 02:14:12 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-26567b38-6019-4206-bb04-fb4fc1cd9a85 1073741824" returned: 0 in 0.512s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-26567b38-6019-4206-bb04-fb4fc1cd9a85 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:12 devstack sudo[90092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-26567b38-6019-4206-bb04-fb4fc1cd9a85 Feb 27 02:14:12 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:12 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-26567b38-6019-4206-bb04-fb4fc1cd9a85" returned: 0 in 0.443s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.384s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-883756699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba38657e-747f-4120-b26f-e85bcf85d57f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='407d12b4a4f64e8abb478a9acbdba02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:10Z,use_quota=True,user_id='7d87ab1c27d44baba81d1dd2233447c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Creating volume ba38657e-747f-4120-b26f-e85bcf85d57f {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:12 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:14:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba38657e-747f-4120-b26f-e85bcf85d57f 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:12 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba38657e-747f-4120-b26f-e85bcf85d57f 1073741824 Feb 27 02:14:12 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed20a0a-02c3-43ff-94a0-5ab1a0508653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26567b38-6019-4206-bb04-fb4fc1cd9a85', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef0f57f-88c8-400b-831e-b88a2c491e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:12 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Volume volume-26567b38-6019-4206-bb04-fb4fc1cd9a85 (26567b38-6019-4206-bb04-fb4fc1cd9a85): created successfully Feb 27 02:14:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef0f57f-88c8-400b-831e-b88a2c491e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Flow 'volume_create_manager' (92ab6457-d781-4292-ae7d-71da41c25d46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:12 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-9a4b9047-09bf-47f7-b640-7e9b9c30bcb8 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Created volume successfully. Feb 27 02:14:13 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba38657e-747f-4120-b26f-e85bcf85d57f 1073741824" returned: 0 in 0.513s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba38657e-747f-4120-b26f-e85bcf85d57f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:13 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba38657e-747f-4120-b26f-e85bcf85d57f Feb 27 02:14:13 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:13 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba38657e-747f-4120-b26f-e85bcf85d57f" returned: 0 in 0.423s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.183s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2048881831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c336dbc0-8530-4adf-b819-e12f528d35e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='407d12b4a4f64e8abb478a9acbdba02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:10Z,use_quota=True,user_id='7d87ab1c27d44baba81d1dd2233447c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Creating volume c336dbc0-8530-4adf-b819-e12f528d35e8 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:13 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:13 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:14:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c336dbc0-8530-4adf-b819-e12f528d35e8 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:13 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26332db1-2ade-48c5-af23-6c855d199a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba38657e-747f-4120-b26f-e85bcf85d57f', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:13 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c336dbc0-8530-4adf-b819-e12f528d35e8 1073741824 Feb 27 02:14:13 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6014574-82c3-4cc6-b2c0-4f3ed184f0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:13 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:13 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Volume volume-ba38657e-747f-4120-b26f-e85bcf85d57f (ba38657e-747f-4120-b26f-e85bcf85d57f): created successfully Feb 27 02:14:13 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6014574-82c3-4cc6-b2c0-4f3ed184f0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:13 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Flow 'volume_create_manager' (1cd3878c-4b8c-40eb-8c15-b88c2919516f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:13 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-6a366861-f20e-4ece-ad6a-0cc89e1b7f56 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Created volume successfully. Feb 27 02:14:14 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c336dbc0-8530-4adf-b819-e12f528d35e8 1073741824" returned: 0 in 0.514s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c336dbc0-8530-4adf-b819-e12f528d35e8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:14 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c336dbc0-8530-4adf-b819-e12f528d35e8 Feb 27 02:14:14 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:14 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c336dbc0-8530-4adf-b819-e12f528d35e8" returned: 0 in 0.406s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:14 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb95b5c-5245-4682-9a67-ce5e385930dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c336dbc0-8530-4adf-b819-e12f528d35e8', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d324c2b-2657-4848-a84f-b81f91150255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:14 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Volume volume-c336dbc0-8530-4adf-b819-e12f528d35e8 (c336dbc0-8530-4adf-b819-e12f528d35e8): created successfully Feb 27 02:14:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d324c2b-2657-4848-a84f-b81f91150255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:14 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Flow 'volume_create_manager' (d456f1ff-b8d6-4b56-b97a-2e20f8bbb8c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:14 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-534be075-d6d6-415d-bf4b-6d4689e8e90e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Created volume successfully. Feb 27 02:14:14 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-65a84f6f-10d6-499f-be23-0bf551165c5b tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "cinder-c336dbc0-8530-4adf-b819-e12f528d35e8-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:14 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-65a84f6f-10d6-499f-be23-0bf551165c5b tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-c336dbc0-8530-4adf-b819-e12f528d35e8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:14 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-65a84f6f-10d6-499f-be23-0bf551165c5b tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "cinder-quobyte-c336dbc0-8530-4adf-b819-e12f528d35e8" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:14 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-65a84f6f-10d6-499f-be23-0bf551165c5b tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-quobyte-c336dbc0-8530-4adf-b819-e12f528d35e8" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:14 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[76554f8d-1ac5-4be1-aecd-f67b8f4ed891]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-65a84f6f-10d6-499f-be23-0bf551165c5b tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c336dbc0-8530-4adf-b819-e12f528d35e8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:15 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c336dbc0-8530-4adf-b819-e12f528d35e8 Feb 27 02:14:15 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:15 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-65a84f6f-10d6-499f-be23-0bf551165c5b tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c336dbc0-8530-4adf-b819-e12f528d35e8" returned: 0 in 0.505s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-65a84f6f-10d6-499f-be23-0bf551165c5b tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c336dbc0-8530-4adf-b819-e12f528d35e8 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:15 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c336dbc0-8530-4adf-b819-e12f528d35e8 Feb 27 02:14:15 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:15 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-65a84f6f-10d6-499f-be23-0bf551165c5b tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-c336dbc0-8530-4adf-b819-e12f528d35e8" returned: 0 in 0.415s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-65a84f6f-10d6-499f-be23-0bf551165c5b tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-quobyte-c336dbc0-8530-4adf-b819-e12f528d35e8" released by "delete_volume" :: held 0.945s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:15 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-65a84f6f-10d6-499f-be23-0bf551165c5b tempest-CreateVolumesFromSnapshotTest-1848332629 None] Created reservations ['bae3849a-b4e2-461c-b41f-b0412a5f53ea', 'c69520e1-61a5-4cab-9eb8-13ed4752d725', '873b9157-eb9d-4e6f-abd5-00946798f442', 'd4c9f628-640f-4464-88d5-bef491297d4d'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-65a84f6f-10d6-499f-be23-0bf551165c5b tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-65a84f6f-10d6-499f-be23-0bf551165c5b tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-65a84f6f-10d6-499f-be23-0bf551165c5b tempest-CreateVolumesFromSnapshotTest-1848332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-65a84f6f-10d6-499f-be23-0bf551165c5b tempest-CreateVolumesFromSnapshotTest-1848332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-65a84f6f-10d6-499f-be23-0bf551165c5b tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-65a84f6f-10d6-499f-be23-0bf551165c5b tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:16 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:14:16 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:16 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-23aedc8d-1d39-45c9-bbd6-8e08f6ab0dd5 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "cinder-ba38657e-747f-4120-b26f-e85bcf85d57f-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:16 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-23aedc8d-1d39-45c9-bbd6-8e08f6ab0dd5 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-ba38657e-747f-4120-b26f-e85bcf85d57f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:16 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-23aedc8d-1d39-45c9-bbd6-8e08f6ab0dd5 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "cinder-quobyte-ba38657e-747f-4120-b26f-e85bcf85d57f" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:16 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-23aedc8d-1d39-45c9-bbd6-8e08f6ab0dd5 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-quobyte-ba38657e-747f-4120-b26f-e85bcf85d57f" acquired by "delete_volume" :: waited 0.021s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:16 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1127a1-5298-427d-96ca-2e7bd99857f0]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-23aedc8d-1d39-45c9-bbd6-8e08f6ab0dd5 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba38657e-747f-4120-b26f-e85bcf85d57f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:16 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba38657e-747f-4120-b26f-e85bcf85d57f Feb 27 02:14:16 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:16 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-65a84f6f-10d6-499f-be23-0bf551165c5b tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.463s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:16 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-65a84f6f-10d6-499f-be23-0bf551165c5b tempest-CreateVolumesFromSnapshotTest-1848332629 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:16 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-65a84f6f-10d6-499f-be23-0bf551165c5b tempest-CreateVolumesFromSnapshotTest-1848332629 None] Deleted volume successfully. Feb 27 02:14:16 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-65a84f6f-10d6-499f-be23-0bf551165c5b tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-c336dbc0-8530-4adf-b819-e12f528d35e8-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:16 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-23aedc8d-1d39-45c9-bbd6-8e08f6ab0dd5 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba38657e-747f-4120-b26f-e85bcf85d57f" returned: 0 in 0.508s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-23aedc8d-1d39-45c9-bbd6-8e08f6ab0dd5 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba38657e-747f-4120-b26f-e85bcf85d57f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:16 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba38657e-747f-4120-b26f-e85bcf85d57f Feb 27 02:14:16 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:17 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-23aedc8d-1d39-45c9-bbd6-8e08f6ab0dd5 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ba38657e-747f-4120-b26f-e85bcf85d57f" returned: 0 in 0.418s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:17 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-23aedc8d-1d39-45c9-bbd6-8e08f6ab0dd5 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-quobyte-ba38657e-747f-4120-b26f-e85bcf85d57f" released by "delete_volume" :: held 0.951s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:17 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-23aedc8d-1d39-45c9-bbd6-8e08f6ab0dd5 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Created reservations ['699c0be7-f592-4793-951c-b110fea8469f', '7e4ab70d-d313-4ad3-869f-24482d3b9e44', '854ae44a-4b19-40fe-8d78-9add6035a5f8', 'f14e1751-75cb-4e32-b930-9c6b56648d37'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-23aedc8d-1d39-45c9-bbd6-8e08f6ab0dd5 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-23aedc8d-1d39-45c9-bbd6-8e08f6ab0dd5 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:17 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-23aedc8d-1d39-45c9-bbd6-8e08f6ab0dd5 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:17 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-23aedc8d-1d39-45c9-bbd6-8e08f6ab0dd5 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-23aedc8d-1d39-45c9-bbd6-8e08f6ab0dd5 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-23aedc8d-1d39-45c9-bbd6-8e08f6ab0dd5 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:17 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:14:17 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:17 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-6b9950e0-5f9f-421a-8935-2c70f9a5a761 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "cinder-26567b38-6019-4206-bb04-fb4fc1cd9a85-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:17 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-6b9950e0-5f9f-421a-8935-2c70f9a5a761 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-26567b38-6019-4206-bb04-fb4fc1cd9a85-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:17 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-6b9950e0-5f9f-421a-8935-2c70f9a5a761 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "cinder-quobyte-26567b38-6019-4206-bb04-fb4fc1cd9a85" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:17 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-6b9950e0-5f9f-421a-8935-2c70f9a5a761 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-quobyte-26567b38-6019-4206-bb04-fb4fc1cd9a85" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:17 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5d8089-89c0-4607-bd15-e9f3b707f376]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6b9950e0-5f9f-421a-8935-2c70f9a5a761 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-26567b38-6019-4206-bb04-fb4fc1cd9a85 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:17 devstack sudo[90139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-26567b38-6019-4206-bb04-fb4fc1cd9a85 Feb 27 02:14:17 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:17 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-23aedc8d-1d39-45c9-bbd6-8e08f6ab0dd5 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.448s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:17 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-23aedc8d-1d39-45c9-bbd6-8e08f6ab0dd5 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:17 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-23aedc8d-1d39-45c9-bbd6-8e08f6ab0dd5 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Deleted volume successfully. Feb 27 02:14:17 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-23aedc8d-1d39-45c9-bbd6-8e08f6ab0dd5 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-ba38657e-747f-4120-b26f-e85bcf85d57f-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:17 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6b9950e0-5f9f-421a-8935-2c70f9a5a761 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-26567b38-6019-4206-bb04-fb4fc1cd9a85" returned: 0 in 0.490s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6b9950e0-5f9f-421a-8935-2c70f9a5a761 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-26567b38-6019-4206-bb04-fb4fc1cd9a85 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:17 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-26567b38-6019-4206-bb04-fb4fc1cd9a85 Feb 27 02:14:17 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:18 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6b9950e0-5f9f-421a-8935-2c70f9a5a761 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-26567b38-6019-4206-bb04-fb4fc1cd9a85" returned: 0 in 0.414s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-6b9950e0-5f9f-421a-8935-2c70f9a5a761 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-quobyte-26567b38-6019-4206-bb04-fb4fc1cd9a85" released by "delete_volume" :: held 0.926s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:18 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-6b9950e0-5f9f-421a-8935-2c70f9a5a761 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Created reservations ['e090d625-be10-4f97-a05d-69f60c17f4bf', 'f6689752-8a31-44fc-9f43-0d0c474c3577', 'c2a8e53c-f356-4b44-b65a-01a902560109', 'a6577dea-c327-46a9-8ac5-b8a8f955e39e'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6b9950e0-5f9f-421a-8935-2c70f9a5a761 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6b9950e0-5f9f-421a-8935-2c70f9a5a761 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:18 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-6b9950e0-5f9f-421a-8935-2c70f9a5a761 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:18 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-6b9950e0-5f9f-421a-8935-2c70f9a5a761 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6b9950e0-5f9f-421a-8935-2c70f9a5a761 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6b9950e0-5f9f-421a-8935-2c70f9a5a761 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:18 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:14:18 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-231cda26-abce-4db4-8cf4-2e94ea681584 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "cinder-4fdd5b6a-b454-4db9-906b-30b8669f12e9-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-231cda26-abce-4db4-8cf4-2e94ea681584 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-4fdd5b6a-b454-4db9-906b-30b8669f12e9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-231cda26-abce-4db4-8cf4-2e94ea681584 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "cinder-quobyte-4fdd5b6a-b454-4db9-906b-30b8669f12e9" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-231cda26-abce-4db4-8cf4-2e94ea681584 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-quobyte-4fdd5b6a-b454-4db9-906b-30b8669f12e9" acquired by "delete_volume" :: waited 0.008s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:18 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9cf0fa-761c-406e-99c1-d209f6de796f]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-231cda26-abce-4db4-8cf4-2e94ea681584 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4fdd5b6a-b454-4db9-906b-30b8669f12e9 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:18 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4fdd5b6a-b454-4db9-906b-30b8669f12e9 Feb 27 02:14:18 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:18 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6b9950e0-5f9f-421a-8935-2c70f9a5a761 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.456s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:18 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-6b9950e0-5f9f-421a-8935-2c70f9a5a761 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:18 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-6b9950e0-5f9f-421a-8935-2c70f9a5a761 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Deleted volume successfully. Feb 27 02:14:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-6b9950e0-5f9f-421a-8935-2c70f9a5a761 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-26567b38-6019-4206-bb04-fb4fc1cd9a85-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:18 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-231cda26-abce-4db4-8cf4-2e94ea681584 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4fdd5b6a-b454-4db9-906b-30b8669f12e9" returned: 0 in 0.491s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-231cda26-abce-4db4-8cf4-2e94ea681584 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4fdd5b6a-b454-4db9-906b-30b8669f12e9 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:18 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4fdd5b6a-b454-4db9-906b-30b8669f12e9 Feb 27 02:14:18 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:19 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-231cda26-abce-4db4-8cf4-2e94ea681584 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4fdd5b6a-b454-4db9-906b-30b8669f12e9" returned: 0 in 0.412s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:19 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-231cda26-abce-4db4-8cf4-2e94ea681584 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-quobyte-4fdd5b6a-b454-4db9-906b-30b8669f12e9" released by "delete_volume" :: held 0.925s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:19 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-231cda26-abce-4db4-8cf4-2e94ea681584 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Created reservations ['b4ba077c-ffa5-4470-8a35-bf0efea6db7f', '86b204b1-8854-4884-90c3-b69faa4630a2', '7d57f5cc-f8d6-4c80-ba89-73a4b0f1ab39', '07687d73-e8e7-4048-8fb9-cad3f32af123'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-231cda26-abce-4db4-8cf4-2e94ea681584 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-231cda26-abce-4db4-8cf4-2e94ea681584 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:19 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-231cda26-abce-4db4-8cf4-2e94ea681584 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:19 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-231cda26-abce-4db4-8cf4-2e94ea681584 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-231cda26-abce-4db4-8cf4-2e94ea681584 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-231cda26-abce-4db4-8cf4-2e94ea681584 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:19 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:14:19 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:19 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c9ace38b-7e3a-43cb-aa94-e84e0e28282e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "cinder-42c50218-df6c-415b-b0ec-b35d3a566655-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:19 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c9ace38b-7e3a-43cb-aa94-e84e0e28282e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-42c50218-df6c-415b-b0ec-b35d3a566655-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:19 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c9ace38b-7e3a-43cb-aa94-e84e0e28282e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "cinder-quobyte-42c50218-df6c-415b-b0ec-b35d3a566655" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:19 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c9ace38b-7e3a-43cb-aa94-e84e0e28282e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-quobyte-42c50218-df6c-415b-b0ec-b35d3a566655" acquired by "delete_volume" :: waited 0.008s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:19 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85a27ed-cc79-41de-b080-f985a3843cd5]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c9ace38b-7e3a-43cb-aa94-e84e0e28282e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-42c50218-df6c-415b-b0ec-b35d3a566655 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:19 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-42c50218-df6c-415b-b0ec-b35d3a566655 Feb 27 02:14:19 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:19 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-231cda26-abce-4db4-8cf4-2e94ea681584 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.437s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:19 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-231cda26-abce-4db4-8cf4-2e94ea681584 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:19 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-231cda26-abce-4db4-8cf4-2e94ea681584 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Deleted volume successfully. Feb 27 02:14:19 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-231cda26-abce-4db4-8cf4-2e94ea681584 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-4fdd5b6a-b454-4db9-906b-30b8669f12e9-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:20 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c9ace38b-7e3a-43cb-aa94-e84e0e28282e tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-42c50218-df6c-415b-b0ec-b35d3a566655" returned: 0 in 0.487s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c9ace38b-7e3a-43cb-aa94-e84e0e28282e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-42c50218-df6c-415b-b0ec-b35d3a566655 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:20 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-42c50218-df6c-415b-b0ec-b35d3a566655 Feb 27 02:14:20 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:20 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c9ace38b-7e3a-43cb-aa94-e84e0e28282e tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-42c50218-df6c-415b-b0ec-b35d3a566655" returned: 0 in 0.427s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c9ace38b-7e3a-43cb-aa94-e84e0e28282e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-quobyte-42c50218-df6c-415b-b0ec-b35d3a566655" released by "delete_volume" :: held 0.944s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-c9ace38b-7e3a-43cb-aa94-e84e0e28282e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Created reservations ['1e87272e-a3a1-432a-a042-2d039b9f74e7', '26410c31-8c6b-4270-900c-0719bfafae64', 'be26bfd1-024d-40c3-9a56-96b3c52033c5', '4d549fa1-488f-4033-b7df-6e7d3b78174c'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c9ace38b-7e3a-43cb-aa94-e84e0e28282e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c9ace38b-7e3a-43cb-aa94-e84e0e28282e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-c9ace38b-7e3a-43cb-aa94-e84e0e28282e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-c9ace38b-7e3a-43cb-aa94-e84e0e28282e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c9ace38b-7e3a-43cb-aa94-e84e0e28282e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c9ace38b-7e3a-43cb-aa94-e84e0e28282e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:20 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:14:20 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "cinder-ac72c504-c29c-497a-9c03-31e27ccc5631-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-ac72c504-c29c-497a-9c03-31e27ccc5631-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "cinder-quobyte-055c84ff-7bf2-4ab4-a79f-9fe768a209ff" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-quobyte-055c84ff-7bf2-4ab4-a79f-9fe768a209ff" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "cinder-quobyte-ac72c504-c29c-497a-9c03-31e27ccc5631" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-quobyte-ac72c504-c29c-497a-9c03-31e27ccc5631" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Deleting offline snapshot ac72c504-c29c-497a-9c03-31e27ccc5631 of volume 055c84ff-7bf2-4ab4-a79f-9fe768a209ff {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] snapshot_file for this snap is: volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.ac72c504-c29c-497a-9c03-31e27ccc5631 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd10316-4bec-41e4-b9b6-2880d81da2df]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.ac72c504-c29c-497a-9c03-31e27ccc5631 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:20 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.ac72c504-c29c-497a-9c03-31e27ccc5631 Feb 27 02:14:20 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:21 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c9ace38b-7e3a-43cb-aa94-e84e0e28282e tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.485s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:21 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-c9ace38b-7e3a-43cb-aa94-e84e0e28282e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:21 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-c9ace38b-7e3a-43cb-aa94-e84e0e28282e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Deleted volume successfully. Feb 27 02:14:21 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c9ace38b-7e3a-43cb-aa94-e84e0e28282e tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-42c50218-df6c-415b-b0ec-b35d3a566655-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:21 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.ac72c504-c29c-497a-9c03-31e27ccc5631" returned: 0 in 0.495s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:21 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:14:21 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[e167786a-a460-4dc4-b3d4-50ad05f70265]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:21 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff Feb 27 02:14:21 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:21 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff" returned: 0 in 0.485s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.ac72c504-c29c-497a-9c03-31e27ccc5631 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:21 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.ac72c504-c29c-497a-9c03-31e27ccc5631 Feb 27 02:14:21 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:22 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.ac72c504-c29c-497a-9c03-31e27ccc5631" returned: 0 in 0.443s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.ac72c504-c29c-497a-9c03-31e27ccc5631 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:22 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.ac72c504-c29c-497a-9c03-31e27ccc5631 Feb 27 02:14:22 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:22 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff.ac72c504-c29c-497a-9c03-31e27ccc5631" returned: 0 in 0.421s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-quobyte-ac72c504-c29c-497a-9c03-31e27ccc5631" released by "_delete_snapshot" :: held 1.916s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-quobyte-055c84ff-7bf2-4ab4-a79f-9fe768a209ff" released by "delete_snapshot" :: held 1.929s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:22 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Created reservations ['707da80b-c0cf-4ad3-95a8-65cd8266faa1', '36478dfa-d037-4303-92a8-7f0eca137b3e', '9deaca0e-1988-43f5-963c-570935cf67ff', '4054ee75-9830-4e32-b4be-9dfbdae2eeca'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:22 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Delete snapshot completed successfully. Feb 27 02:14:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-fb63107b-7f41-4ec3-b4e5-6f7f88092327 tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-ac72c504-c29c-497a-9c03-31e27ccc5631-delete_snapshot" released by "delete_snapshot" :: held 2.019s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-48e72c0b-fd79-4226-a65b-cab2c3f4947c tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "cinder-055c84ff-7bf2-4ab4-a79f-9fe768a209ff-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-48e72c0b-fd79-4226-a65b-cab2c3f4947c tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-055c84ff-7bf2-4ab4-a79f-9fe768a209ff-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-48e72c0b-fd79-4226-a65b-cab2c3f4947c tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "cinder-quobyte-055c84ff-7bf2-4ab4-a79f-9fe768a209ff" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-48e72c0b-fd79-4226-a65b-cab2c3f4947c tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-quobyte-055c84ff-7bf2-4ab4-a79f-9fe768a209ff" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:22 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c7ca96-b4c8-48b3-803e-6825cb5057f1]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-48e72c0b-fd79-4226-a65b-cab2c3f4947c tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:22 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff Feb 27 02:14:22 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:23 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-48e72c0b-fd79-4226-a65b-cab2c3f4947c tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff" returned: 0 in 0.521s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-48e72c0b-fd79-4226-a65b-cab2c3f4947c tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:23 devstack sudo[90232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff Feb 27 02:14:23 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:23 devstack cinder-volume[82738]: DEBUG oslo_service.periodic_task [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82738) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:14:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:23 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:14:23 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:23 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-48e72c0b-fd79-4226-a65b-cab2c3f4947c tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-055c84ff-7bf2-4ab4-a79f-9fe768a209ff" returned: 0 in 0.460s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:23 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-48e72c0b-fd79-4226-a65b-cab2c3f4947c tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-quobyte-055c84ff-7bf2-4ab4-a79f-9fe768a209ff" released by "delete_volume" :: held 1.021s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:23 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-48e72c0b-fd79-4226-a65b-cab2c3f4947c tempest-CreateVolumesFromSnapshotTest-1848332629 None] Created reservations ['11324e1b-9765-4d84-b87b-f718d36065af', '0619ffa0-8033-48f0-a34a-875c75d7c923', 'aadded87-795b-45d4-9926-68160c67c06f', '4c57ffd7-0ebe-4304-b9d0-e45c0fc73560'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-48e72c0b-fd79-4226-a65b-cab2c3f4947c tempest-CreateVolumesFromSnapshotTest-1848332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-48e72c0b-fd79-4226-a65b-cab2c3f4947c tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-48e72c0b-fd79-4226-a65b-cab2c3f4947c tempest-CreateVolumesFromSnapshotTest-1848332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-48e72c0b-fd79-4226-a65b-cab2c3f4947c tempest-CreateVolumesFromSnapshotTest-1848332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-48e72c0b-fd79-4226-a65b-cab2c3f4947c tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-48e72c0b-fd79-4226-a65b-cab2c3f4947c tempest-CreateVolumesFromSnapshotTest-1848332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:23 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:14:23 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:24 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.474s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:24 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:24 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-48e72c0b-fd79-4226-a65b-cab2c3f4947c tempest-CreateVolumesFromSnapshotTest-1848332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.452s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:24 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-48e72c0b-fd79-4226-a65b-cab2c3f4947c tempest-CreateVolumesFromSnapshotTest-1848332629 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:24 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-48e72c0b-fd79-4226-a65b-cab2c3f4947c tempest-CreateVolumesFromSnapshotTest-1848332629 None] Deleted volume successfully. Feb 27 02:14:24 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-48e72c0b-fd79-4226-a65b-cab2c3f4947c tempest-CreateVolumesFromSnapshotTest-1848332629 None] Lock "cinder-055c84ff-7bf2-4ab4-a79f-9fe768a209ff-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Flow 'volume_create_manager' (080561ce-97f6-4d35-a9d2-5c52cb121118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5deec3-332a-4e4e-be34-5834e8e125d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5deec3-332a-4e4e-be34-5834e8e125d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1920917592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac4c03a6-a910-4226-8f91-e41f8569a8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e9c25acf894684a65640a439a34935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:32Z,use_quota=True,user_id='f68a10659542415880ed4ce0d0c326df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c45de4-b0a8-4548-8e9c-6ca97e140c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c45de4-b0a8-4548-8e9c-6ca97e140c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88013e87-1bbd-4598-9e82-9aafdd74ed1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88013e87-1bbd-4598-9e82-9aafdd74ed1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac4c03a6-a910-4226-8f91-e41f8569a8ce', 'volume_name': 'volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc110a3-f01d-4c25-aaf1-f0c45ea31d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc110a3-f01d-4c25-aaf1-f0c45ea31d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938af727-346d-44fe-b1e7-70635e737c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Volume ac4c03a6-a910-4226-8f91-e41f8569a8ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce', 'volume_size': 1} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1920917592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac4c03a6-a910-4226-8f91-e41f8569a8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e9c25acf894684a65640a439a34935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:32Z,use_quota=True,user_id='f68a10659542415880ed4ce0d0c326df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Creating volume ac4c03a6-a910-4226-8f91-e41f8569a8ce {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:32 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:32 devstack sudo[90282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce 1073741824 Feb 27 02:14:32 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Flow 'volume_create_manager' (1929e80c-7105-4196-8e5b-64d60141e1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01290b4-74ec-4f56-b3e8-f6f9462b50ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01290b4-74ec-4f56-b3e8-f6f9462b50ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-61627722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6d85ee-9dae-4ff0-83dd-717957142ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2752207484c4c309122930c4b3bf324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:32Z,use_quota=True,user_id='01bb858cb8d14afe818f4dbb6cedb1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1315a4d9-30fa-4b5c-887f-32a62e3772e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1315a4d9-30fa-4b5c-887f-32a62e3772e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c1ac63-a43d-4828-90e8-643b876a79e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c1ac63-a43d-4828-90e8-643b876a79e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd6d85ee-9dae-4ff0-83dd-717957142ab4', 'volume_name': 'volume-dd6d85ee-9dae-4ff0-83dd-717957142ab4', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (305d52ad-83e2-40f7-9a9a-bac5d9f74035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (305d52ad-83e2-40f7-9a9a-bac5d9f74035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7128c1-f945-45f3-a2b9-94c4e40d64f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Volume dd6d85ee-9dae-4ff0-83dd-717957142ab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd6d85ee-9dae-4ff0-83dd-717957142ab4', 'volume_size': 1} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Flow 'volume_create_manager' (435ca83e-25db-4f4a-9099-d43fd5992b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ea0622-ca73-4748-b28e-3497310a7247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ea0622-ca73-4748-b28e-3497310a7247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-661796315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec37027deac47fbb42f9eb4b6e93367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:33Z,use_quota=True,user_id='0bc838fe8bd8454595acece693d4702d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544987c0-ef2b-4db8-bb18-2d6053ca6542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544987c0-ef2b-4db8-bb18-2d6053ca6542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6b041f-dec4-4f27-a33c-225f51ca7533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6b041f-dec4-4f27-a33c-225f51ca7533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf', 'volume_name': 'volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4890a963-0fdf-4241-8af1-fd70456a751d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4890a963-0fdf-4241-8af1-fd70456a751d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6885a3d-cece-4fb4-b681-63ce8d673f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Volume d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf', 'volume_size': 1} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Flow 'volume_create_manager' (0abf6410-6098-4026-8223-9514fa16014b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62dd2f5-5a47-4374-80a2-9c15d9f0801f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62dd2f5-5a47-4374-80a2-9c15d9f0801f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1962521835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa197c0e-40b0-49ac-8833-ef7acea9ad0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2752207484c4c309122930c4b3bf324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:33Z,use_quota=True,user_id='01bb858cb8d14afe818f4dbb6cedb1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3e63dd-4cee-46da-a047-8f522209b627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3e63dd-4cee-46da-a047-8f522209b627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1343658e-f1eb-4721-b2d3-f8e2059d8878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1343658e-f1eb-4721-b2d3-f8e2059d8878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa197c0e-40b0-49ac-8833-ef7acea9ad0c', 'volume_name': 'volume-aa197c0e-40b0-49ac-8833-ef7acea9ad0c', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c154b2-fca3-4153-9d0f-ded34a99e0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c154b2-fca3-4153-9d0f-ded34a99e0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e742a0bc-186a-4a1f-8275-4271f4157ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Volume aa197c0e-40b0-49ac-8833-ef7acea9ad0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa197c0e-40b0-49ac-8833-ef7acea9ad0c', 'volume_size': 1} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Flow 'volume_create_manager' (db0ddc63-d5a8-49b9-bd5d-f230c3434a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e89b637-0444-48b0-b79d-50d7c48051be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e89b637-0444-48b0-b79d-50d7c48051be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1739839110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7617fb68-f223-43ef-bf3f-9212fc3c038b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2752207484c4c309122930c4b3bf324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:33Z,use_quota=True,user_id='01bb858cb8d14afe818f4dbb6cedb1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3691a96-1a06-48a4-be17-87916fb6c436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3691a96-1a06-48a4-be17-87916fb6c436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e52ef80-ba47-478b-a87e-172e21ad27bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e52ef80-ba47-478b-a87e-172e21ad27bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7617fb68-f223-43ef-bf3f-9212fc3c038b', 'volume_name': 'volume-7617fb68-f223-43ef-bf3f-9212fc3c038b', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (731ed67f-dc4c-4ae4-8a07-f06654b33d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (731ed67f-dc4c-4ae4-8a07-f06654b33d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfc73a2-6459-4043-992a-1bb2853e375d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Volume 7617fb68-f223-43ef-bf3f-9212fc3c038b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7617fb68-f223-43ef-bf3f-9212fc3c038b', 'volume_size': 1} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:32 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce 1073741824" returned: 0 in 0.714s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:32 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce Feb 27 02:14:32 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Flow 'volume_create_manager' (9f4afa43-cc81-4243-897c-7b0fdf38fb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08648c52-7c17-4c89-adb7-1c9e6f67cadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08648c52-7c17-4c89-adb7-1c9e6f67cadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-715918014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd5cd823-13c2-4deb-9374-e7a543670e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2752207484c4c309122930c4b3bf324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:33Z,use_quota=True,user_id='01bb858cb8d14afe818f4dbb6cedb1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf6486f-cc38-40ae-9271-63d7822b5724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf6486f-cc38-40ae-9271-63d7822b5724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cce464-0152-47b6-96e6-55ae060e6b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cce464-0152-47b6-96e6-55ae060e6b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd5cd823-13c2-4deb-9374-e7a543670e56', 'volume_name': 'volume-cd5cd823-13c2-4deb-9374-e7a543670e56', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e77d8be-1746-467e-9d53-746e4760c8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e77d8be-1746-467e-9d53-746e4760c8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e7c7d5-df6c-425d-831f-c11bf4e30f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:33 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Volume cd5cd823-13c2-4deb-9374-e7a543670e56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd5cd823-13c2-4deb-9374-e7a543670e56', 'volume_size': 1} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Flow 'volume_create_manager' (d02c3a47-6837-4c2e-9bc2-567ebe9b8be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44477193-1d68-43f5-b180-424098b63f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44477193-1d68-43f5-b180-424098b63f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1786163050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b170dfc-3bd4-428f-a29b-dc7736557018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2752207484c4c309122930c4b3bf324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:33Z,use_quota=True,user_id='01bb858cb8d14afe818f4dbb6cedb1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86aa4500-09a8-49fc-8cc4-f6530790fd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86aa4500-09a8-49fc-8cc4-f6530790fd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8fea01-1edf-49c4-b624-c262fb093f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8fea01-1edf-49c4-b624-c262fb093f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b170dfc-3bd4-428f-a29b-dc7736557018', 'volume_name': 'volume-1b170dfc-3bd4-428f-a29b-dc7736557018', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569c9e61-bbf1-4277-94d3-532054649f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569c9e61-bbf1-4277-94d3-532054649f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73574d7c-95c7-4d8a-bf96-a195261c3dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:33 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Volume 1b170dfc-3bd4-428f-a29b-dc7736557018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b170dfc-3bd4-428f-a29b-dc7736557018', 'volume_size': 1} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:33 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce" returned: 0 in 0.522s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.035s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-61627722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6d85ee-9dae-4ff0-83dd-717957142ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2752207484c4c309122930c4b3bf324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:32Z,use_quota=True,user_id='01bb858cb8d14afe818f4dbb6cedb1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Creating volume dd6d85ee-9dae-4ff0-83dd-717957142ab4 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:33 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-dd6d85ee-9dae-4ff0-83dd-717957142ab4 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938af727-346d-44fe-b1e7-70635e737c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eab28bf-b1ab-4e26-82ca-ee8a4ef0b976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:33 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-dd6d85ee-9dae-4ff0-83dd-717957142ab4 1073741824 Feb 27 02:14:33 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:33 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Volume volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce (ac4c03a6-a910-4226-8f91-e41f8569a8ce): created successfully Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eab28bf-b1ab-4e26-82ca-ee8a4ef0b976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Flow 'volume_create_manager' (080561ce-97f6-4d35-a9d2-5c52cb121118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:33 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-5164e7e6-11bb-4852-90c5-6b66d9d94bfc tempest-VolumeDependencyTests-1320295309 None] Created volume successfully. Feb 27 02:14:33 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-dd6d85ee-9dae-4ff0-83dd-717957142ab4 1073741824" returned: 0 in 0.531s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-dd6d85ee-9dae-4ff0-83dd-717957142ab4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:34 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-dd6d85ee-9dae-4ff0-83dd-717957142ab4 Feb 27 02:14:34 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-302ade5b-67f3-4285-820b-efb60fdb74c5 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:34 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-dd6d85ee-9dae-4ff0-83dd-717957142ab4" returned: 0 in 0.458s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:34 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.828s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:34 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-661796315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec37027deac47fbb42f9eb4b6e93367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:33Z,use_quota=True,user_id='0bc838fe8bd8454595acece693d4702d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:34 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Creating volume d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:34 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:34 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:34 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:34 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:14:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:34 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7128c1-f945-45f3-a2b9-94c4e40d64f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd6d85ee-9dae-4ff0-83dd-717957142ab4', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:34 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e33d4a-198f-4440-87d5-c8caa63b5fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:34 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf 1073741824 Feb 27 02:14:34 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:34 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Volume volume-dd6d85ee-9dae-4ff0-83dd-717957142ab4 (dd6d85ee-9dae-4ff0-83dd-717957142ab4): created successfully Feb 27 02:14:34 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e33d4a-198f-4440-87d5-c8caa63b5fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:34 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Flow 'volume_create_manager' (1929e80c-7105-4196-8e5b-64d60141e1f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:34 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-53b9e44e-1e18-46c4-9c1a-89798b19ff1e tempest-CreateVolumesFromImageTest-1010040539 None] Created volume successfully. Feb 27 02:14:35 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf 1073741824" returned: 0 in 0.532s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:35 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf Feb 27 02:14:35 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:35 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf" returned: 0 in 0.483s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.777s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1962521835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa197c0e-40b0-49ac-8833-ef7acea9ad0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2752207484c4c309122930c4b3bf324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:33Z,use_quota=True,user_id='01bb858cb8d14afe818f4dbb6cedb1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Creating volume aa197c0e-40b0-49ac-8833-ef7acea9ad0c {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:35 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:35 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:14:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-aa197c0e-40b0-49ac-8833-ef7acea9ad0c 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6885a3d-cece-4fb4-b681-63ce8d673f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e17cc37-28dc-4eb4-920a-ceeb93331ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:35 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-aa197c0e-40b0-49ac-8833-ef7acea9ad0c 1073741824 Feb 27 02:14:35 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:35 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Volume volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf (d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf): created successfully Feb 27 02:14:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e17cc37-28dc-4eb4-920a-ceeb93331ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:35 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Flow 'volume_create_manager' (435ca83e-25db-4f4a-9099-d43fd5992b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:35 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-c9152964-678c-4d83-bffc-882722b7355c tempest-CreateVolumesFromSnapshotTest-283718236 None] Created volume successfully. Feb 27 02:14:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6651a6c7-3178-46d0-b434-f919370753b5 tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:36 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-aa197c0e-40b0-49ac-8833-ef7acea9ad0c 1073741824" returned: 0 in 0.567s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-aa197c0e-40b0-49ac-8833-ef7acea9ad0c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:36 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-aa197c0e-40b0-49ac-8833-ef7acea9ad0c Feb 27 02:14:36 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:36 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-aa197c0e-40b0-49ac-8833-ef7acea9ad0c" returned: 0 in 0.480s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:36 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.747s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:36 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1739839110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7617fb68-f223-43ef-bf3f-9212fc3c038b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2752207484c4c309122930c4b3bf324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:33Z,use_quota=True,user_id='01bb858cb8d14afe818f4dbb6cedb1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:36 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Creating volume 7617fb68-f223-43ef-bf3f-9212fc3c038b {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:36 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:36 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:36 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:36 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:14:36 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7617fb68-f223-43ef-bf3f-9212fc3c038b 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:36 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e742a0bc-186a-4a1f-8275-4271f4157ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa197c0e-40b0-49ac-8833-ef7acea9ad0c', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:36 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a44e85-f174-425c-b0f8-bd0d6ac77524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:36 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7617fb68-f223-43ef-bf3f-9212fc3c038b 1073741824 Feb 27 02:14:36 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:36 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Volume volume-aa197c0e-40b0-49ac-8833-ef7acea9ad0c (aa197c0e-40b0-49ac-8833-ef7acea9ad0c): created successfully Feb 27 02:14:36 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a44e85-f174-425c-b0f8-bd0d6ac77524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:36 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Flow 'volume_create_manager' (0abf6410-6098-4026-8223-9514fa16014b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:36 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e5fda346-f888-413c-9e45-45a67e59c927 tempest-CreateVolumesFromImageTest-1010040539 None] Created volume successfully. Feb 27 02:14:37 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7617fb68-f223-43ef-bf3f-9212fc3c038b 1073741824" returned: 0 in 0.587s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:37 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=107,cinder:UPDATE=151,cinder:DELETE=13,cinder:INSERT=33 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:14:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7617fb68-f223-43ef-bf3f-9212fc3c038b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:37 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7617fb68-f223-43ef-bf3f-9212fc3c038b Feb 27 02:14:37 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:37 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7617fb68-f223-43ef-bf3f-9212fc3c038b" returned: 0 in 0.611s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:37 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.717s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:37 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-715918014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd5cd823-13c2-4deb-9374-e7a543670e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2752207484c4c309122930c4b3bf324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:33Z,use_quota=True,user_id='01bb858cb8d14afe818f4dbb6cedb1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:37 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Creating volume cd5cd823-13c2-4deb-9374-e7a543670e56 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:37 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:37 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:37 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:37 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:14:37 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cd5cd823-13c2-4deb-9374-e7a543670e56 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:37 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfc73a2-6459-4043-992a-1bb2853e375d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7617fb68-f223-43ef-bf3f-9212fc3c038b', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:37 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3c4727-ed76-4231-9676-d8bd5a86e803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:37 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cd5cd823-13c2-4deb-9374-e7a543670e56 1073741824 Feb 27 02:14:37 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:37 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Volume volume-7617fb68-f223-43ef-bf3f-9212fc3c038b (7617fb68-f223-43ef-bf3f-9212fc3c038b): created successfully Feb 27 02:14:37 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3c4727-ed76-4231-9676-d8bd5a86e803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:37 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Flow 'volume_create_manager' (db0ddc63-d5a8-49b9-bd5d-f230c3434a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:37 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-929addd0-5f79-4ed5-84e8-3271ce45ad73 tempest-CreateVolumesFromImageTest-1010040539 None] Created volume successfully. Feb 27 02:14:38 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cd5cd823-13c2-4deb-9374-e7a543670e56 1073741824" returned: 0 in 0.687s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:38 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:SELECT=108,cinder:UPDATE=156,cinder:INSERT=36,cinder:DELETE=15 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:14:38 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cd5cd823-13c2-4deb-9374-e7a543670e56 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:38 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cd5cd823-13c2-4deb-9374-e7a543670e56 Feb 27 02:14:38 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:39 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cd5cd823-13c2-4deb-9374-e7a543670e56" returned: 0 in 0.538s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:39 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.697s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:39 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1786163050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b170dfc-3bd4-428f-a29b-dc7736557018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2752207484c4c309122930c4b3bf324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:33Z,use_quota=True,user_id='01bb858cb8d14afe818f4dbb6cedb1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:39 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Creating volume 1b170dfc-3bd4-428f-a29b-dc7736557018 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:39 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:39 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:39 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:39 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:14:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1b170dfc-3bd4-428f-a29b-dc7736557018 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:39 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e7c7d5-df6c-425d-831f-c11bf4e30f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd5cd823-13c2-4deb-9374-e7a543670e56', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:39 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1b170dfc-3bd4-428f-a29b-dc7736557018 1073741824 Feb 27 02:14:39 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:39 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ffcd4c2-c98d-41b2-b1e7-54978c2f1d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:39 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Volume volume-cd5cd823-13c2-4deb-9374-e7a543670e56 (cd5cd823-13c2-4deb-9374-e7a543670e56): created successfully Feb 27 02:14:39 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ffcd4c2-c98d-41b2-b1e7-54978c2f1d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:39 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Flow 'volume_create_manager' (9f4afa43-cc81-4243-897c-7b0fdf38fb00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:39 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-d34de8fc-1189-4f6d-bb90-f72ab053ebc7 tempest-CreateVolumesFromImageTest-1010040539 None] Created volume successfully. Feb 27 02:14:39 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1b170dfc-3bd4-428f-a29b-dc7736557018 1073741824" returned: 0 in 0.567s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:39 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1b170dfc-3bd4-428f-a29b-dc7736557018 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:39 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1b170dfc-3bd4-428f-a29b-dc7736557018 Feb 27 02:14:39 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:40 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1b170dfc-3bd4-428f-a29b-dc7736557018" returned: 0 in 0.496s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:40 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-302ade5b-67f3-4285-820b-efb60fdb74c5 tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.768s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:40 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73574d7c-95c7-4d8a-bf96-a195261c3dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b170dfc-3bd4-428f-a29b-dc7736557018', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:40 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb3641f-fb64-48db-a752-f68787ef9bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:40 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-302ade5b-67f3-4285-820b-efb60fdb74c5 tempest-VolumeDependencyTests-1320295309 None] Creating offline snapshot e939d9f6-7fc1-4832-9abe-15bb59f83b92 of volume ac4c03a6-a910-4226-8f91-e41f8569a8ce {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:14:40 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Volume volume-1b170dfc-3bd4-428f-a29b-dc7736557018 (1b170dfc-3bd4-428f-a29b-dc7736557018): created successfully Feb 27 02:14:40 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb3641f-fb64-48db-a752-f68787ef9bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:40 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Flow 'volume_create_manager' (d02c3a47-6837-4c2e-9bc2-567ebe9b8be4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:40 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f23b342-166d-4aa6-a033-7f7d31eab6bf]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-302ade5b-67f3-4285-820b-efb60fdb74c5 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:40 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-237e1bea-16ea-4899-b856-0c6247f9d374 tempest-CreateVolumesFromImageTest-1010040539 None] Created volume successfully. Feb 27 02:14:40 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce Feb 27 02:14:40 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:40 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-302ade5b-67f3-4285-820b-efb60fdb74c5 tempest-VolumeDependencyTests-1320295309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce" returned: 0 in 0.525s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:40 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-302ade5b-67f3-4285-820b-efb60fdb74c5 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:40 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92 1G Feb 27 02:14:40 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:40 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d5475b6e-1a9a-423d-b7b7-52bf8e26e10a tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "cinder-1b170dfc-3bd4-428f-a29b-dc7736557018-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:40 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d5475b6e-1a9a-423d-b7b7-52bf8e26e10a tempest-CreateVolumesFromImageTest-1010040539 None] Lock "cinder-1b170dfc-3bd4-428f-a29b-dc7736557018-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:41 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d5475b6e-1a9a-423d-b7b7-52bf8e26e10a tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "cinder-quobyte-1b170dfc-3bd4-428f-a29b-dc7736557018" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:41 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d5475b6e-1a9a-423d-b7b7-52bf8e26e10a tempest-CreateVolumesFromImageTest-1010040539 None] Lock "cinder-quobyte-1b170dfc-3bd4-428f-a29b-dc7736557018" acquired by "delete_volume" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:41 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[0818f808-23ca-49bc-b2ab-3460c3325154]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d5475b6e-1a9a-423d-b7b7-52bf8e26e10a tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1b170dfc-3bd4-428f-a29b-dc7736557018 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:41 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1b170dfc-3bd4-428f-a29b-dc7736557018 Feb 27 02:14:41 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:41 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-302ade5b-67f3-4285-820b-efb60fdb74c5 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92 1G" returned: 0 in 0.583s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-302ade5b-67f3-4285-820b-efb60fdb74c5 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:41 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92 Feb 27 02:14:41 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:41 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d5475b6e-1a9a-423d-b7b7-52bf8e26e10a tempest-CreateVolumesFromImageTest-1010040539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1b170dfc-3bd4-428f-a29b-dc7736557018" returned: 0 in 0.541s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d5475b6e-1a9a-423d-b7b7-52bf8e26e10a tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1b170dfc-3bd4-428f-a29b-dc7736557018 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:41 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1b170dfc-3bd4-428f-a29b-dc7736557018 Feb 27 02:14:41 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:41 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-302ade5b-67f3-4285-820b-efb60fdb74c5 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92" returned: 0 in 0.442s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:41 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-302ade5b-67f3-4285-820b-efb60fdb74c5 tempest-VolumeDependencyTests-1320295309 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92 is being set with open permissions: ugo+rw Feb 27 02:14:41 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-302ade5b-67f3-4285-820b-efb60fdb74c5 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:41 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92 Feb 27 02:14:41 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:42 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d5475b6e-1a9a-423d-b7b7-52bf8e26e10a tempest-CreateVolumesFromImageTest-1010040539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-1b170dfc-3bd4-428f-a29b-dc7736557018" returned: 0 in 0.465s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:42 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d5475b6e-1a9a-423d-b7b7-52bf8e26e10a tempest-CreateVolumesFromImageTest-1010040539 None] Lock "cinder-quobyte-1b170dfc-3bd4-428f-a29b-dc7736557018" released by "delete_volume" :: held 1.032s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:42 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-d5475b6e-1a9a-423d-b7b7-52bf8e26e10a tempest-CreateVolumesFromImageTest-1010040539 None] Created reservations ['9099a331-6f5b-40ad-a960-f128f4415a79', '328f6e43-8fcf-4d68-b64e-208502898e21', 'e5b2a54f-0375-447d-b932-5ed8089367e2', 'bbc51f55-3d98-4794-b345-2cb132495add'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d5475b6e-1a9a-423d-b7b7-52bf8e26e10a tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d5475b6e-1a9a-423d-b7b7-52bf8e26e10a tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:42 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d5475b6e-1a9a-423d-b7b7-52bf8e26e10a tempest-CreateVolumesFromImageTest-1010040539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:42 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d5475b6e-1a9a-423d-b7b7-52bf8e26e10a tempest-CreateVolumesFromImageTest-1010040539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d5475b6e-1a9a-423d-b7b7-52bf8e26e10a tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d5475b6e-1a9a-423d-b7b7-52bf8e26e10a tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:42 devstack sudo[90364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:14:42 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:42 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-302ade5b-67f3-4285-820b-efb60fdb74c5 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92" returned: 0 in 0.517s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-302ade5b-67f3-4285-820b-efb60fdb74c5 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:42 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.info Feb 27 02:14:42 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:42 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d5475b6e-1a9a-423d-b7b7-52bf8e26e10a tempest-CreateVolumesFromImageTest-1010040539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.484s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:42 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-d5475b6e-1a9a-423d-b7b7-52bf8e26e10a tempest-CreateVolumesFromImageTest-1010040539 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:42 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-d5475b6e-1a9a-423d-b7b7-52bf8e26e10a tempest-CreateVolumesFromImageTest-1010040539 None] Deleted volume successfully. Feb 27 02:14:42 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d5475b6e-1a9a-423d-b7b7-52bf8e26e10a tempest-CreateVolumesFromImageTest-1010040539 None] Lock "cinder-1b170dfc-3bd4-428f-a29b-dc7736557018-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:42 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-302ade5b-67f3-4285-820b-efb60fdb74c5 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.info" returned: 0 in 0.436s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:42 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-302ade5b-67f3-4285-820b-efb60fdb74c5 tempest-VolumeDependencyTests-1320295309 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.info is being set with open permissions: ugo+rw Feb 27 02:14:42 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-302ade5b-67f3-4285-820b-efb60fdb74c5 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:42 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.info Feb 27 02:14:42 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-957f6eb4-18f6-41b8-b1c5-3cb66bf64908 tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "cinder-cd5cd823-13c2-4deb-9374-e7a543670e56-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-957f6eb4-18f6-41b8-b1c5-3cb66bf64908 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "cinder-cd5cd823-13c2-4deb-9374-e7a543670e56-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-957f6eb4-18f6-41b8-b1c5-3cb66bf64908 tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "cinder-quobyte-cd5cd823-13c2-4deb-9374-e7a543670e56" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:43 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-957f6eb4-18f6-41b8-b1c5-3cb66bf64908 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "cinder-quobyte-cd5cd823-13c2-4deb-9374-e7a543670e56" acquired by "delete_volume" :: waited 0.008s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:43 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d42f7c2-86de-4108-88cf-68ec3e21950b]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-957f6eb4-18f6-41b8-b1c5-3cb66bf64908 tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cd5cd823-13c2-4deb-9374-e7a543670e56 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:43 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cd5cd823-13c2-4deb-9374-e7a543670e56 Feb 27 02:14:43 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:43 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-302ade5b-67f3-4285-820b-efb60fdb74c5 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.info" returned: 0 in 0.566s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-302ade5b-67f3-4285-820b-efb60fdb74c5 tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.169s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6651a6c7-3178-46d0-b434-f919370753b5 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.578s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:43 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-6651a6c7-3178-46d0-b434-f919370753b5 tempest-CreateVolumesFromSnapshotTest-283718236 None] Creating offline snapshot 569d91fd-00b4-4a4a-8416-23ae1f398031 of volume d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:14:43 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-302ade5b-67f3-4285-820b-efb60fdb74c5 tempest-VolumeDependencyTests-1320295309 None] Create snapshot completed successfully Feb 27 02:14:43 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b8de72-8863-407b-b651-303a3658880c]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6651a6c7-3178-46d0-b434-f919370753b5 tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:43 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf Feb 27 02:14:43 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:43 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-957f6eb4-18f6-41b8-b1c5-3cb66bf64908 tempest-CreateVolumesFromImageTest-1010040539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cd5cd823-13c2-4deb-9374-e7a543670e56" returned: 0 in 0.560s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:43 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-957f6eb4-18f6-41b8-b1c5-3cb66bf64908 tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cd5cd823-13c2-4deb-9374-e7a543670e56 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:43 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cd5cd823-13c2-4deb-9374-e7a543670e56 Feb 27 02:14:43 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:44 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6651a6c7-3178-46d0-b434-f919370753b5 tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf" returned: 0 in 0.650s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6651a6c7-3178-46d0-b434-f919370753b5 tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.569d91fd-00b4-4a4a-8416-23ae1f398031 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:44 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.569d91fd-00b4-4a4a-8416-23ae1f398031 1G Feb 27 02:14:44 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Flow 'volume_create_manager' (2b245658-9cfd-473b-8c94-ad1c7b14090d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5306ce03-d2d6-4685-b7fd-17665e6441f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5306ce03-d2d6-4685-b7fd-17665e6441f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1731784827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b52880e-5e9d-47ff-a208-ba443ecb9787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e9c25acf894684a65640a439a34935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e939d9f6-7fc1-4832-9abe-15bb59f83b92,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:44Z,use_quota=True,user_id='f68a10659542415880ed4ce0d0c326df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f5ee4b-b3a4-4034-8f8c-88ed8f5a7154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f5ee4b-b3a4-4034-8f8c-88ed8f5a7154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0600bb4a-4e61-4457-b82f-90871841c1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0600bb4a-4e61-4457-b82f-90871841c1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6b52880e-5e9d-47ff-a208-ba443ecb9787', 'volume_name': 'volume-6b52880e-5e9d-47ff-a208-ba443ecb9787', 'volume_size': 1, 'snapshot_id': 'e939d9f6-7fc1-4832-9abe-15bb59f83b92'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c692cb02-21b5-4d23-aea0-879b6896ab02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c692cb02-21b5-4d23-aea0-879b6896ab02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb37d557-a543-4197-8aa6-930b11278c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:44 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Volume 6b52880e-5e9d-47ff-a208-ba443ecb9787: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6b52880e-5e9d-47ff-a208-ba443ecb9787', 'volume_size': 1, 'snapshot_id': 'e939d9f6-7fc1-4832-9abe-15bb59f83b92'} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:44 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-957f6eb4-18f6-41b8-b1c5-3cb66bf64908 tempest-CreateVolumesFromImageTest-1010040539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-cd5cd823-13c2-4deb-9374-e7a543670e56" returned: 0 in 0.831s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-957f6eb4-18f6-41b8-b1c5-3cb66bf64908 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "cinder-quobyte-cd5cd823-13c2-4deb-9374-e7a543670e56" released by "delete_volume" :: held 1.422s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-957f6eb4-18f6-41b8-b1c5-3cb66bf64908 tempest-CreateVolumesFromImageTest-1010040539 None] Created reservations ['a0d3e6db-b27d-487c-8432-838321a75886', 'be53a64f-4103-4967-bae6-ccf977d7ec02', '649a2ef1-2656-4583-9625-c5f73005dd2c', '83f99e7c-f6f7-4ac7-a903-6534a1343a77'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-957f6eb4-18f6-41b8-b1c5-3cb66bf64908 tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-957f6eb4-18f6-41b8-b1c5-3cb66bf64908 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-957f6eb4-18f6-41b8-b1c5-3cb66bf64908 tempest-CreateVolumesFromImageTest-1010040539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-957f6eb4-18f6-41b8-b1c5-3cb66bf64908 tempest-CreateVolumesFromImageTest-1010040539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-957f6eb4-18f6-41b8-b1c5-3cb66bf64908 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-957f6eb4-18f6-41b8-b1c5-3cb66bf64908 tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:44 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:14:44 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:44 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6651a6c7-3178-46d0-b434-f919370753b5 tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.569d91fd-00b4-4a4a-8416-23ae1f398031 1G" returned: 0 in 0.729s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:44 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6651a6c7-3178-46d0-b434-f919370753b5 tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.569d91fd-00b4-4a4a-8416-23ae1f398031 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:44 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.569d91fd-00b4-4a4a-8416-23ae1f398031 Feb 27 02:14:44 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:45 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-957f6eb4-18f6-41b8-b1c5-3cb66bf64908 tempest-CreateVolumesFromImageTest-1010040539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.541s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:45 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-957f6eb4-18f6-41b8-b1c5-3cb66bf64908 tempest-CreateVolumesFromImageTest-1010040539 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:45 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-957f6eb4-18f6-41b8-b1c5-3cb66bf64908 tempest-CreateVolumesFromImageTest-1010040539 None] Deleted volume successfully. Feb 27 02:14:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-957f6eb4-18f6-41b8-b1c5-3cb66bf64908 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "cinder-cd5cd823-13c2-4deb-9374-e7a543670e56-delete_volume" released by "delete_volume" :: held 2.132s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a7feb7bb-eaba-4bd2-8206-66484b892140 tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "cinder-7617fb68-f223-43ef-bf3f-9212fc3c038b-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a7feb7bb-eaba-4bd2-8206-66484b892140 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "cinder-7617fb68-f223-43ef-bf3f-9212fc3c038b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a7feb7bb-eaba-4bd2-8206-66484b892140 tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "cinder-quobyte-7617fb68-f223-43ef-bf3f-9212fc3c038b" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:45 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a7feb7bb-eaba-4bd2-8206-66484b892140 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "cinder-quobyte-7617fb68-f223-43ef-bf3f-9212fc3c038b" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:45 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f786b7-c4f3-4caf-8a78-e5c2b37afbe6]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a7feb7bb-eaba-4bd2-8206-66484b892140 tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7617fb68-f223-43ef-bf3f-9212fc3c038b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:45 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6651a6c7-3178-46d0-b434-f919370753b5 tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.569d91fd-00b4-4a4a-8416-23ae1f398031" returned: 0 in 0.662s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:45 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-6651a6c7-3178-46d0-b434-f919370753b5 tempest-CreateVolumesFromSnapshotTest-283718236 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.569d91fd-00b4-4a4a-8416-23ae1f398031 is being set with open permissions: ugo+rw Feb 27 02:14:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6651a6c7-3178-46d0-b434-f919370753b5 tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.569d91fd-00b4-4a4a-8416-23ae1f398031 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:45 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.569d91fd-00b4-4a4a-8416-23ae1f398031 Feb 27 02:14:45 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:45 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7617fb68-f223-43ef-bf3f-9212fc3c038b Feb 27 02:14:45 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:45 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6651a6c7-3178-46d0-b434-f919370753b5 tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.569d91fd-00b4-4a4a-8416-23ae1f398031" returned: 0 in 0.451s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:45 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6651a6c7-3178-46d0-b434-f919370753b5 tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:46 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.info Feb 27 02:14:46 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:46 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a7feb7bb-eaba-4bd2-8206-66484b892140 tempest-CreateVolumesFromImageTest-1010040539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7617fb68-f223-43ef-bf3f-9212fc3c038b" returned: 0 in 0.693s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a7feb7bb-eaba-4bd2-8206-66484b892140 tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7617fb68-f223-43ef-bf3f-9212fc3c038b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:46 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7617fb68-f223-43ef-bf3f-9212fc3c038b Feb 27 02:14:46 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:46 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6651a6c7-3178-46d0-b434-f919370753b5 tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.info" returned: 0 in 0.541s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:46 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-6651a6c7-3178-46d0-b434-f919370753b5 tempest-CreateVolumesFromSnapshotTest-283718236 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.info is being set with open permissions: ugo+rw Feb 27 02:14:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6651a6c7-3178-46d0-b434-f919370753b5 tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:46 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.info Feb 27 02:14:46 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:46 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a7feb7bb-eaba-4bd2-8206-66484b892140 tempest-CreateVolumesFromImageTest-1010040539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-7617fb68-f223-43ef-bf3f-9212fc3c038b" returned: 0 in 0.513s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:46 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a7feb7bb-eaba-4bd2-8206-66484b892140 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "cinder-quobyte-7617fb68-f223-43ef-bf3f-9212fc3c038b" released by "delete_volume" :: held 1.234s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:46 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-a7feb7bb-eaba-4bd2-8206-66484b892140 tempest-CreateVolumesFromImageTest-1010040539 None] Created reservations ['46b0e26f-0b16-41f5-bbae-9e78888fca82', '74767493-3b79-4f46-bbdf-d045c2844aa9', 'e9089f46-f381-4105-9d79-2be680f05a71', '75006053-fbda-4d2a-9fc7-2e81fc03d77e'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a7feb7bb-eaba-4bd2-8206-66484b892140 tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a7feb7bb-eaba-4bd2-8206-66484b892140 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-a7feb7bb-eaba-4bd2-8206-66484b892140 tempest-CreateVolumesFromImageTest-1010040539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:46 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-a7feb7bb-eaba-4bd2-8206-66484b892140 tempest-CreateVolumesFromImageTest-1010040539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a7feb7bb-eaba-4bd2-8206-66484b892140 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:46 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a7feb7bb-eaba-4bd2-8206-66484b892140 tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:46 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:14:46 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:47 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6651a6c7-3178-46d0-b434-f919370753b5 tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.info" returned: 0 in 0.576s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6651a6c7-3178-46d0-b434-f919370753b5 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.700s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.637s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "cinder-quobyte-e939d9f6-7fc1-4832-9abe-15bb59f83b92-6b52880e-5e9d-47ff-a208-ba443ecb9787" by "_create_volume_from_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:47 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-6651a6c7-3178-46d0-b434-f919370753b5 tempest-CreateVolumesFromSnapshotTest-283718236 None] Create snapshot completed successfully Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-quobyte-e939d9f6-7fc1-4832-9abe-15bb59f83b92-6b52880e-5e9d-47ff-a208-ba443ecb9787" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Creating volume 6b52880e-5e9d-47ff-a208-ba443ecb9787 from snapshot e939d9f6-7fc1-4832-9abe-15bb59f83b92 {{(pid=82738) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "cinder-quobyte-6b52880e-5e9d-47ff-a208-ba443ecb9787" by "_copy_volume_from_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-quobyte-6b52880e-5e9d-47ff-a208-ba443ecb9787" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] snapshot: e939d9f6-7fc1-4832-9abe-15bb59f83b92, volume: 6b52880e-5e9d-47ff-a208-ba443ecb9787, {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33f67f2-2d4a-4dc8-93e0-11b876e4ead0]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Flow 'volume_create_manager' (c96944e9-5400-413e-9eb4-a0c06caf1ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832372aa-85ae-4951-9b43-ba2a1209021c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832372aa-85ae-4951-9b43-ba2a1209021c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2053066060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fbadee5-ccfc-4205-b17d-d1f1010378a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1890bbba76e7440b8edcdfc97c8048ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:47Z,use_quota=True,user_id='e041380ba53245d8ba7b4b9bd1c33038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb3d89d-50ce-429b-987c-63a5119a29de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb3d89d-50ce-429b-987c-63a5119a29de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3164942b-136c-4d5f-b964-b2357a5959e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3164942b-136c-4d5f-b964-b2357a5959e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fbadee5-ccfc-4205-b17d-d1f1010378a0', 'volume_name': 'volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686ec916-f10d-43e4-8c01-c60cc633c9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686ec916-f10d-43e4-8c01-c60cc633c9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:47 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92 Feb 27 02:14:47 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7aab4d-d88f-4cf9-90b4-865a73277667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:47 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Volume 3fbadee5-ccfc-4205-b17d-d1f1010378a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0', 'volume_size': 1} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:47 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a7feb7bb-eaba-4bd2-8206-66484b892140 tempest-CreateVolumesFromImageTest-1010040539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.514s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-a7feb7bb-eaba-4bd2-8206-66484b892140 tempest-CreateVolumesFromImageTest-1010040539 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:47 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-a7feb7bb-eaba-4bd2-8206-66484b892140 tempest-CreateVolumesFromImageTest-1010040539 None] Deleted volume successfully. Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a7feb7bb-eaba-4bd2-8206-66484b892140 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "cinder-7617fb68-f223-43ef-bf3f-9212fc3c038b-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Flow 'volume_create_manager' (b4420b8f-5a5b-4146-b6fa-233e7c4e45a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18026e5-0bed-4c0e-96c5-d95f8fd70f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18026e5-0bed-4c0e-96c5-d95f8fd70f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-31106799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222ee42c-8561-4a4b-baa3-b086ae5de9b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec37027deac47fbb42f9eb4b6e93367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:47Z,use_quota=True,user_id='0bc838fe8bd8454595acece693d4702d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267edc87-d132-4a02-b111-b877dfa08f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267edc87-d132-4a02-b111-b877dfa08f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70069517-08d7-4638-b844-7b0eaff5b3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70069517-08d7-4638-b844-7b0eaff5b3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '222ee42c-8561-4a4b-baa3-b086ae5de9b7', 'volume_name': 'volume-222ee42c-8561-4a4b-baa3-b086ae5de9b7', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26913a71-d0be-4e2d-b19e-de6a579bc39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26913a71-d0be-4e2d-b19e-de6a579bc39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ca93ae-56b4-43e4-94be-5496a2790345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:47 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Volume 222ee42c-8561-4a4b-baa3-b086ae5de9b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-222ee42c-8561-4a4b-baa3-b086ae5de9b7', 'volume_size': 1} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e8b2302b-2e00-4da7-bb98-4ddda5de8a14 tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "cinder-aa197c0e-40b0-49ac-8833-ef7acea9ad0c-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e8b2302b-2e00-4da7-bb98-4ddda5de8a14 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "cinder-aa197c0e-40b0-49ac-8833-ef7acea9ad0c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e8b2302b-2e00-4da7-bb98-4ddda5de8a14 tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "cinder-quobyte-aa197c0e-40b0-49ac-8833-ef7acea9ad0c" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e8b2302b-2e00-4da7-bb98-4ddda5de8a14 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "cinder-quobyte-aa197c0e-40b0-49ac-8833-ef7acea9ad0c" acquired by "delete_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5f27fe-4308-464e-ab94-c876ad1ceaa1]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e8b2302b-2e00-4da7-bb98-4ddda5de8a14 tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-aa197c0e-40b0-49ac-8833-ef7acea9ad0c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Flow 'volume_create_manager' (e4ec43a2-f8d3-4432-9eb6-7fbaffc59bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8964b59a-c137-4991-8c4c-511e03d11702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:47 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8964b59a-c137-4991-8c4c-511e03d11702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-156624593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8edef8a0-d8c3-4081-87ef-0518173d6f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec37027deac47fbb42f9eb4b6e93367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:48Z,use_quota=True,user_id='0bc838fe8bd8454595acece693d4702d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3babaea4-7ac3-4fec-a4e1-40bb7f492cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:47 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-aa197c0e-40b0-49ac-8833-ef7acea9ad0c Feb 27 02:14:47 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3babaea4-7ac3-4fec-a4e1-40bb7f492cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90abf77a-0f58-47af-84d0-7b2f10b63b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90abf77a-0f58-47af-84d0-7b2f10b63b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8edef8a0-d8c3-4081-87ef-0518173d6f43', 'volume_name': 'volume-8edef8a0-d8c3-4081-87ef-0518173d6f43', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a903b067-3155-41e2-993f-400771a08b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a903b067-3155-41e2-993f-400771a08b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef8461f5-a671-44ac-8b0d-2c677f4c5f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:47 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Volume 8edef8a0-d8c3-4081-87ef-0518173d6f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8edef8a0-d8c3-4081-87ef-0518173d6f43', 'volume_size': 1} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92" returned: 0 in 0.636s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Creating direct copy from snapshot {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7b24e8-2b2d-4065-afa0-0d043735d96b]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:47 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:47 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce Feb 27 02:14:47 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Flow 'volume_create_manager' (705b1f71-3e0a-4e57-86eb-a751b99ff136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab89f76-725c-4fa3-ba2b-3404f9b2b59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab89f76-725c-4fa3-ba2b-3404f9b2b59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-770579168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2209db73-259d-48be-bdd3-7ba8bfc72db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec37027deac47fbb42f9eb4b6e93367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:48Z,use_quota=True,user_id='0bc838fe8bd8454595acece693d4702d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e299d34-bf6c-4626-8328-a281bc9a55d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e299d34-bf6c-4626-8328-a281bc9a55d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322c2a60-b004-430c-9947-f173acdf40a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322c2a60-b004-430c-9947-f173acdf40a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2209db73-259d-48be-bdd3-7ba8bfc72db4', 'volume_name': 'volume-2209db73-259d-48be-bdd3-7ba8bfc72db4', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e676725-1f8f-4747-bf77-973b8f7210bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e676725-1f8f-4747-bf77-973b8f7210bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76c73a3-2606-4a17-8883-f3f06847fcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:48 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Volume 2209db73-259d-48be-bdd3-7ba8bfc72db4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2209db73-259d-48be-bdd3-7ba8bfc72db4', 'volume_size': 1} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Flow 'volume_create_manager' (ec1c8bef-640d-478c-9740-246f103e5de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118d5315-077e-47cf-a333-742efb2a90c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118d5315-077e-47cf-a333-742efb2a90c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2133554142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85bc1183-6e6f-4099-bbd0-8a5c834ab92e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec37027deac47fbb42f9eb4b6e93367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:48Z,use_quota=True,user_id='0bc838fe8bd8454595acece693d4702d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9972d7-6ad4-4495-bba7-deef0ab01cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9972d7-6ad4-4495-bba7-deef0ab01cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f8878a-be41-46fd-8923-88de67056a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f8878a-be41-46fd-8923-88de67056a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85bc1183-6e6f-4099-bbd0-8a5c834ab92e', 'volume_name': 'volume-85bc1183-6e6f-4099-bbd0-8a5c834ab92e', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644af07d-91f8-47ba-8f26-aec398866ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644af07d-91f8-47ba-8f26-aec398866ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66046d37-41e4-4fa1-bc73-7177d9a9aabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:48 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Volume 85bc1183-6e6f-4099-bbd0-8a5c834ab92e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85bc1183-6e6f-4099-bbd0-8a5c834ab92e', 'volume_size': 1} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:48 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e8b2302b-2e00-4da7-bb98-4ddda5de8a14 tempest-CreateVolumesFromImageTest-1010040539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-aa197c0e-40b0-49ac-8833-ef7acea9ad0c" returned: 0 in 0.587s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e8b2302b-2e00-4da7-bb98-4ddda5de8a14 tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-aa197c0e-40b0-49ac-8833-ef7acea9ad0c {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:48 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-aa197c0e-40b0-49ac-8833-ef7acea9ad0c Feb 27 02:14:48 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Flow 'volume_create_manager' (5967bd9e-7d39-4c5e-adf1-80ac861a256a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd933e6e-9e02-4bfe-953f-cd69f3c9b6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd933e6e-9e02-4bfe-953f-cd69f3c9b6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1882500845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182b1f98-bd99-4b93-8430-b1792bfb1554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec37027deac47fbb42f9eb4b6e93367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:48Z,use_quota=True,user_id='0bc838fe8bd8454595acece693d4702d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead54482-3179-4f15-8e96-9569ec7cfe51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead54482-3179-4f15-8e96-9569ec7cfe51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a4b81d-8c2f-4703-b63d-8a3a8a47dee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:48 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a4b81d-8c2f-4703-b63d-8a3a8a47dee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '182b1f98-bd99-4b93-8430-b1792bfb1554', 'volume_name': 'volume-182b1f98-bd99-4b93-8430-b1792bfb1554', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2194be-8909-46c2-a1b3-072fb92c88ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2194be-8909-46c2-a1b3-072fb92c88ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b9df5f-cd09-433c-9c7e-69e130d05b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:48 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Volume 182b1f98-bd99-4b93-8430-b1792bfb1554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-182b1f98-bd99-4b93-8430-b1792bfb1554', 'volume_size': 1} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce" returned: 0 in 0.707s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.utils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Path /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6b52880e-5e9d-47ff-a208-ba443ecb9787 not found in is_blk_device check {{(pid=82738) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6b52880e-5e9d-47ff-a208-ba443ecb9787 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:48 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6b52880e-5e9d-47ff-a208-ba443ecb9787 Feb 27 02:14:48 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:48 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e8b2302b-2e00-4da7-bb98-4ddda5de8a14 tempest-CreateVolumesFromImageTest-1010040539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-aa197c0e-40b0-49ac-8833-ef7acea9ad0c" returned: 0 in 0.507s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e8b2302b-2e00-4da7-bb98-4ddda5de8a14 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "cinder-quobyte-aa197c0e-40b0-49ac-8833-ef7acea9ad0c" released by "delete_volume" :: held 1.136s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-e8b2302b-2e00-4da7-bb98-4ddda5de8a14 tempest-CreateVolumesFromImageTest-1010040539 None] Created reservations ['b9b51e55-8152-4cd2-a014-912526bd130b', 'd551cb16-ce4f-4c22-a40a-87567b5b94ee', 'ca20da94-a938-4e4c-b00a-4d2fa2dc0a53', 'e32ea9ec-9099-4faf-a35b-6eb12b23a2e4'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e8b2302b-2e00-4da7-bb98-4ddda5de8a14 tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e8b2302b-2e00-4da7-bb98-4ddda5de8a14 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e8b2302b-2e00-4da7-bb98-4ddda5de8a14 tempest-CreateVolumesFromImageTest-1010040539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e8b2302b-2e00-4da7-bb98-4ddda5de8a14 tempest-CreateVolumesFromImageTest-1010040539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e8b2302b-2e00-4da7-bb98-4ddda5de8a14 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:48 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e8b2302b-2e00-4da7-bb98-4ddda5de8a14 tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:48 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:14:48 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:50 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-330ddac3-845d-4984-b018-f43870f75af7 tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "cinder-dd6d85ee-9dae-4ff0-83dd-717957142ab4-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:50 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-330ddac3-845d-4984-b018-f43870f75af7 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "cinder-dd6d85ee-9dae-4ff0-83dd-717957142ab4-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:50 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-330ddac3-845d-4984-b018-f43870f75af7 tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "cinder-quobyte-dd6d85ee-9dae-4ff0-83dd-717957142ab4" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:50 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-330ddac3-845d-4984-b018-f43870f75af7 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "cinder-quobyte-dd6d85ee-9dae-4ff0-83dd-717957142ab4" acquired by "delete_volume" :: waited 0.033s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:50 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e50a0f-6b02-400c-9f32-2abe08b63793]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-330ddac3-845d-4984-b018-f43870f75af7 tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-dd6d85ee-9dae-4ff0-83dd-717957142ab4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:50 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e8b2302b-2e00-4da7-bb98-4ddda5de8a14 tempest-CreateVolumesFromImageTest-1010040539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 1.429s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:50 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-e8b2302b-2e00-4da7-bb98-4ddda5de8a14 tempest-CreateVolumesFromImageTest-1010040539 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:50 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e8b2302b-2e00-4da7-bb98-4ddda5de8a14 tempest-CreateVolumesFromImageTest-1010040539 None] Deleted volume successfully. Feb 27 02:14:50 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e8b2302b-2e00-4da7-bb98-4ddda5de8a14 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "cinder-aa197c0e-40b0-49ac-8833-ef7acea9ad0c-delete_volume" released by "delete_volume" :: held 2.747s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:50 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-dd6d85ee-9dae-4ff0-83dd-717957142ab4 Feb 27 02:14:50 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:50 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6b52880e-5e9d-47ff-a208-ba443ecb9787" returned: 0 in 2.363s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:50 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10a7900-d050-4ffc-9984-4871e05d94a9]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:50 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:51 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce Feb 27 02:14:51 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:51 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-330ddac3-845d-4984-b018-f43870f75af7 tempest-CreateVolumesFromImageTest-1010040539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-dd6d85ee-9dae-4ff0-83dd-717957142ab4" returned: 0 in 0.882s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-330ddac3-845d-4984-b018-f43870f75af7 tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-dd6d85ee-9dae-4ff0-83dd-717957142ab4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:51 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-dd6d85ee-9dae-4ff0-83dd-717957142ab4 Feb 27 02:14:51 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:51 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-330ddac3-845d-4984-b018-f43870f75af7 tempest-CreateVolumesFromImageTest-1010040539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-dd6d85ee-9dae-4ff0-83dd-717957142ab4" returned: 0 in 0.442s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:51 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:51 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-330ddac3-845d-4984-b018-f43870f75af7 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "cinder-quobyte-dd6d85ee-9dae-4ff0-83dd-717957142ab4" released by "delete_volume" :: held 1.370s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce" returned: 0 in 0.676s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:51 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce, size 1024.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6b52880e-5e9d-47ff-a208-ba443ecb9787 {{(pid=82738) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:14:51 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Converted 1024.00 MB image at 432.99 MB/s Feb 27 02:14:51 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6b52880e-5e9d-47ff-a208-ba443ecb9787 is being set with open permissions: ugo+rw Feb 27 02:14:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6b52880e-5e9d-47ff-a208-ba443ecb9787 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:51 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6b52880e-5e9d-47ff-a208-ba443ecb9787 Feb 27 02:14:51 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:51 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-330ddac3-845d-4984-b018-f43870f75af7 tempest-CreateVolumesFromImageTest-1010040539 None] Created reservations ['eb72ffad-c40e-44ab-96cc-8b1765c46f6d', '3c9738c1-7145-4e5c-81e0-c4fcf78aca5b', '284d1b4f-78a7-430a-9c15-22d034d612dd', '1c0d0790-b9b7-4709-a479-c5bc3aeea1e1'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-330ddac3-845d-4984-b018-f43870f75af7 tempest-CreateVolumesFromImageTest-1010040539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-330ddac3-845d-4984-b018-f43870f75af7 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-330ddac3-845d-4984-b018-f43870f75af7 tempest-CreateVolumesFromImageTest-1010040539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:51 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-330ddac3-845d-4984-b018-f43870f75af7 tempest-CreateVolumesFromImageTest-1010040539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-330ddac3-845d-4984-b018-f43870f75af7 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:51 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-330ddac3-845d-4984-b018-f43870f75af7 tempest-CreateVolumesFromImageTest-1010040539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:51 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:14:51 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:52 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6b52880e-5e9d-47ff-a208-ba443ecb9787" returned: 0 in 0.449s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-quobyte-6b52880e-5e9d-47ff-a208-ba443ecb9787" released by "_copy_volume_from_snapshot" :: held 4.919s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-quobyte-e939d9f6-7fc1-4832-9abe-15bb59f83b92-6b52880e-5e9d-47ff-a208-ba443ecb9787" released by "_create_volume_from_snapshot" :: held 4.938s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.954s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.773s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2053066060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fbadee5-ccfc-4205-b17d-d1f1010378a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1890bbba76e7440b8edcdfc97c8048ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:47Z,use_quota=True,user_id='e041380ba53245d8ba7b4b9bd1c33038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Creating volume 3fbadee5-ccfc-4205-b17d-d1f1010378a0 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:52 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:52 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 1073741824 Feb 27 02:14:52 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb37d557-a543-4197-8aa6-930b11278c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b52880e-5e9d-47ff-a208-ba443ecb9787', 'volume_size': 1, 'snapshot_id': 'e939d9f6-7fc1-4832-9abe-15bb59f83b92'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37bd4887-3b41-46bd-80d4-0fd8d8930f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:52 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Volume volume-6b52880e-5e9d-47ff-a208-ba443ecb9787 (6b52880e-5e9d-47ff-a208-ba443ecb9787): created successfully Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37bd4887-3b41-46bd-80d4-0fd8d8930f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Flow 'volume_create_manager' (2b245658-9cfd-473b-8c94-ad1c7b14090d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:52 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-330ddac3-845d-4984-b018-f43870f75af7 tempest-CreateVolumesFromImageTest-1010040539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.448s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-330ddac3-845d-4984-b018-f43870f75af7 tempest-CreateVolumesFromImageTest-1010040539 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:52 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-330ddac3-845d-4984-b018-f43870f75af7 tempest-CreateVolumesFromImageTest-1010040539 None] Deleted volume successfully. Feb 27 02:14:52 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-1827d928-c718-459d-a6d3-e3638ad6d19e tempest-VolumeDependencyTests-1320295309 None] Created volume successfully. Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-330ddac3-845d-4984-b018-f43870f75af7 tempest-CreateVolumesFromImageTest-1010040539 None] Lock "cinder-dd6d85ee-9dae-4ff0-83dd-717957142ab4-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:52 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 1073741824" returned: 0 in 0.588s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:52 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 Feb 27 02:14:52 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:52 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "cinder-e939d9f6-7fc1-4832-9abe-15bb59f83b92-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-e939d9f6-7fc1-4832-9abe-15bb59f83b92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "cinder-quobyte-ac4c03a6-a910-4226-8f91-e41f8569a8ce" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-quobyte-ac4c03a6-a910-4226-8f91-e41f8569a8ce" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "cinder-quobyte-e939d9f6-7fc1-4832-9abe-15bb59f83b92" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-quobyte-e939d9f6-7fc1-4832-9abe-15bb59f83b92" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] Deleting offline snapshot e939d9f6-7fc1-4832-9abe-15bb59f83b92 of volume ac4c03a6-a910-4226-8f91-e41f8569a8ce {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] snapshot_file for this snap is: volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12d2190-2c2c-4040-88a1-7bee82cf3d22]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:53 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92 Feb 27 02:14:53 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:53 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0" returned: 0 in 0.477s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.623s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-31106799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222ee42c-8561-4a4b-baa3-b086ae5de9b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec37027deac47fbb42f9eb4b6e93367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:47Z,use_quota=True,user_id='0bc838fe8bd8454595acece693d4702d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Creating volume 222ee42c-8561-4a4b-baa3-b086ae5de9b7 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:53 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-222ee42c-8561-4a4b-baa3-b086ae5de9b7 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7aab4d-d88f-4cf9-90b4-865a73277667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e64a49-f0b1-401a-a663-b994b0e25f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:53 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-222ee42c-8561-4a4b-baa3-b086ae5de9b7 1073741824 Feb 27 02:14:53 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:53 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Volume volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 (3fbadee5-ccfc-4205-b17d-d1f1010378a0): created successfully Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e64a49-f0b1-401a-a663-b994b0e25f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Flow 'volume_create_manager' (c96944e9-5400-413e-9eb4-a0c06caf1ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:53 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-8a5a8fd6-2d43-4ad8-9cd2-064383bdbdfe tempest-SnapshotDependencyTests-1839279197 None] Created volume successfully. Feb 27 02:14:53 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92" returned: 0 in 0.540s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f6827d-7c5e-48d3-aebc-d13e594bdccb]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:53 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce Feb 27 02:14:53 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:53 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-222ee42c-8561-4a4b-baa3-b086ae5de9b7 1073741824" returned: 0 in 0.611s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:53 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-222ee42c-8561-4a4b-baa3-b086ae5de9b7 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:53 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-222ee42c-8561-4a4b-baa3-b086ae5de9b7 Feb 27 02:14:53 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c61f4793-268f-4102-973a-6178efd12c1e tempest-SnapshotDependencyTests-1839279197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:54 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce" returned: 0 in 0.695s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:54 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92 Feb 27 02:14:54 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Flow 'volume_create_manager' (a975d8d3-fa0a-4335-ab91-5b3e87b3bff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c27d225-8a2a-49be-b5e5-ebd21cb94605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c27d225-8a2a-49be-b5e5-ebd21cb94605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-587353214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a345b7a3-c182-47b4-a8f7-fed2433a9f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4375a68889d449d38e95c4f1e0882515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:54Z,use_quota=True,user_id='fe099c2c6d684376993e0d9e37180656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:54 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aaff4cd-2a5e-4eab-9e94-815b0d7b146f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aaff4cd-2a5e-4eab-9e94-815b0d7b146f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed37f37a-9b4d-4996-8aa1-4c74a08b293a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed37f37a-9b4d-4996-8aa1-4c74a08b293a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a345b7a3-c182-47b4-a8f7-fed2433a9f11', 'volume_name': 'volume-a345b7a3-c182-47b4-a8f7-fed2433a9f11', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8d6d61-cfc3-4cec-a235-6c82deb10ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8d6d61-cfc3-4cec-a235-6c82deb10ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde1e28d-71ca-4a80-9856-5ef34d0ccaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:54 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Volume a345b7a3-c182-47b4-a8f7-fed2433a9f11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a345b7a3-c182-47b4-a8f7-fed2433a9f11', 'volume_size': 1} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-222ee42c-8561-4a4b-baa3-b086ae5de9b7" returned: 0 in 0.560s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.564s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-156624593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8edef8a0-d8c3-4081-87ef-0518173d6f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec37027deac47fbb42f9eb4b6e93367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:48Z,use_quota=True,user_id='0bc838fe8bd8454595acece693d4702d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Creating volume 8edef8a0-d8c3-4081-87ef-0518173d6f43 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:54 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8edef8a0-d8c3-4081-87ef-0518173d6f43 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ca93ae-56b4-43e4-94be-5496a2790345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-222ee42c-8561-4a4b-baa3-b086ae5de9b7', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235ffc63-628b-4e4a-8710-91729c46df9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:54 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8edef8a0-d8c3-4081-87ef-0518173d6f43 1073741824 Feb 27 02:14:54 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:54 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Volume volume-222ee42c-8561-4a4b-baa3-b086ae5de9b7 (222ee42c-8561-4a4b-baa3-b086ae5de9b7): created successfully Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235ffc63-628b-4e4a-8710-91729c46df9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Flow 'volume_create_manager' (b4420b8f-5a5b-4146-b6fa-233e7c4e45a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:54 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-3d2afe96-5a68-40ff-8efb-63dda8756874 tempest-CreateVolumesFromSnapshotTest-283718236 None] Created volume successfully. Feb 27 02:14:54 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92" returned: 0 in 0.462s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:54 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92 Feb 27 02:14:54 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:54 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8edef8a0-d8c3-4081-87ef-0518173d6f43 1073741824" returned: 0 in 0.539s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:54 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8edef8a0-d8c3-4081-87ef-0518173d6f43 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:54 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8edef8a0-d8c3-4081-87ef-0518173d6f43 Feb 27 02:14:54 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:55 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce.e939d9f6-7fc1-4832-9abe-15bb59f83b92" returned: 0 in 0.455s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-quobyte-e939d9f6-7fc1-4832-9abe-15bb59f83b92" released by "_delete_snapshot" :: held 2.215s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-quobyte-ac4c03a6-a910-4226-8f91-e41f8569a8ce" released by "delete_snapshot" :: held 2.230s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] Created reservations ['5d38576c-ec92-4f61-a14a-d665f5a1bd09', 'b79cbbc5-1a62-4859-9e94-1db95ff89b4d', '0636be2d-9d0e-4a8b-8641-cba3d6ef42f5', 'cfc23f5d-1054-4949-9efd-5ee2646da71d'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:55 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] Delete snapshot completed successfully. Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-441201ef-9a72-4de1-a32f-adc2880a1319 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-e939d9f6-7fc1-4832-9abe-15bb59f83b92-delete_snapshot" released by "delete_snapshot" :: held 2.328s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:55 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8edef8a0-d8c3-4081-87ef-0518173d6f43" returned: 0 in 0.447s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.323s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-770579168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2209db73-259d-48be-bdd3-7ba8bfc72db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec37027deac47fbb42f9eb4b6e93367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:48Z,use_quota=True,user_id='0bc838fe8bd8454595acece693d4702d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Creating volume 2209db73-259d-48be-bdd3-7ba8bfc72db4 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:55 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2209db73-259d-48be-bdd3-7ba8bfc72db4 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef8461f5-a671-44ac-8b0d-2c677f4c5f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8edef8a0-d8c3-4081-87ef-0518173d6f43', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c333389c-3b24-44e8-96c9-be3aee315b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:55 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2209db73-259d-48be-bdd3-7ba8bfc72db4 1073741824 Feb 27 02:14:55 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:55 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Volume volume-8edef8a0-d8c3-4081-87ef-0518173d6f43 (8edef8a0-d8c3-4081-87ef-0518173d6f43): created successfully Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c333389c-3b24-44e8-96c9-be3aee315b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Flow 'volume_create_manager' (e4ec43a2-f8d3-4432-9eb6-7fbaffc59bd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:55 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-071a5a2f-5fb0-4a57-ac99-f80e43db14e0 tempest-CreateVolumesFromSnapshotTest-283718236 None] Created volume successfully. Feb 27 02:14:55 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2209db73-259d-48be-bdd3-7ba8bfc72db4 1073741824" returned: 0 in 0.463s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:55 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2209db73-259d-48be-bdd3-7ba8bfc72db4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:55 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2209db73-259d-48be-bdd3-7ba8bfc72db4 Feb 27 02:14:55 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e047e364-ad42-44d3-a6cc-c85f17d2ad67 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "cinder-ac4c03a6-a910-4226-8f91-e41f8569a8ce-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e047e364-ad42-44d3-a6cc-c85f17d2ad67 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-ac4c03a6-a910-4226-8f91-e41f8569a8ce-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e047e364-ad42-44d3-a6cc-c85f17d2ad67 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "cinder-quobyte-ac4c03a6-a910-4226-8f91-e41f8569a8ce" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e047e364-ad42-44d3-a6cc-c85f17d2ad67 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-quobyte-ac4c03a6-a910-4226-8f91-e41f8569a8ce" acquired by "delete_volume" :: waited 0.008s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[82247bbc-08fd-4f8c-a8d3-694965695da5]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e047e364-ad42-44d3-a6cc-c85f17d2ad67 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:56 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce Feb 27 02:14:56 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:56 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2209db73-259d-48be-bdd3-7ba8bfc72db4" returned: 0 in 0.439s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.066s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2133554142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85bc1183-6e6f-4099-bbd0-8a5c834ab92e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec37027deac47fbb42f9eb4b6e93367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:48Z,use_quota=True,user_id='0bc838fe8bd8454595acece693d4702d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Creating volume 85bc1183-6e6f-4099-bbd0-8a5c834ab92e {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:56 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-85bc1183-6e6f-4099-bbd0-8a5c834ab92e 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76c73a3-2606-4a17-8883-f3f06847fcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2209db73-259d-48be-bdd3-7ba8bfc72db4', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:56 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-85bc1183-6e6f-4099-bbd0-8a5c834ab92e 1073741824 Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e30769-9543-4183-aa2c-b32f245f32e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:56 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:56 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Volume volume-2209db73-259d-48be-bdd3-7ba8bfc72db4 (2209db73-259d-48be-bdd3-7ba8bfc72db4): created successfully Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e30769-9543-4183-aa2c-b32f245f32e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Flow 'volume_create_manager' (705b1f71-3e0a-4e57-86eb-a751b99ff136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:56 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-bdda001e-65ab-4483-82c1-bf1810511a57 tempest-CreateVolumesFromSnapshotTest-283718236 None] Created volume successfully. Feb 27 02:14:56 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e047e364-ad42-44d3-a6cc-c85f17d2ad67 tempest-VolumeDependencyTests-1320295309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce" returned: 0 in 0.486s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e047e364-ad42-44d3-a6cc-c85f17d2ad67 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:56 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce Feb 27 02:14:56 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:56 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-85bc1183-6e6f-4099-bbd0-8a5c834ab92e 1073741824" returned: 0 in 0.491s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:56 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-85bc1183-6e6f-4099-bbd0-8a5c834ab92e {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:56 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-85bc1183-6e6f-4099-bbd0-8a5c834ab92e Feb 27 02:14:56 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:57 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e047e364-ad42-44d3-a6cc-c85f17d2ad67 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-ac4c03a6-a910-4226-8f91-e41f8569a8ce" returned: 0 in 0.462s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e047e364-ad42-44d3-a6cc-c85f17d2ad67 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-quobyte-ac4c03a6-a910-4226-8f91-e41f8569a8ce" released by "delete_volume" :: held 0.977s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-e047e364-ad42-44d3-a6cc-c85f17d2ad67 tempest-VolumeDependencyTests-1320295309 None] Created reservations ['1c2ddca2-001e-4276-b684-09d0fb962d8d', '17b039b7-99ab-4acf-a8f2-0f796b11f22d', 'f6840123-9625-4f23-851f-56d2adbe4bf2', '75b43ec6-63fb-42a7-94ff-cefb17624d8a'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e047e364-ad42-44d3-a6cc-c85f17d2ad67 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e047e364-ad42-44d3-a6cc-c85f17d2ad67 tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e047e364-ad42-44d3-a6cc-c85f17d2ad67 tempest-VolumeDependencyTests-1320295309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e047e364-ad42-44d3-a6cc-c85f17d2ad67 tempest-VolumeDependencyTests-1320295309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e047e364-ad42-44d3-a6cc-c85f17d2ad67 tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e047e364-ad42-44d3-a6cc-c85f17d2ad67 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:57 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:14:57 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:57 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-85bc1183-6e6f-4099-bbd0-8a5c834ab92e" returned: 0 in 0.436s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.766s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1882500845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182b1f98-bd99-4b93-8430-b1792bfb1554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec37027deac47fbb42f9eb4b6e93367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:48Z,use_quota=True,user_id='0bc838fe8bd8454595acece693d4702d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Creating volume 182b1f98-bd99-4b93-8430-b1792bfb1554 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:57 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-182b1f98-bd99-4b93-8430-b1792bfb1554 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66046d37-41e4-4fa1-bc73-7177d9a9aabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85bc1183-6e6f-4099-bbd0-8a5c834ab92e', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c278259-dbd6-422c-ab85-6889b8faac00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:57 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-182b1f98-bd99-4b93-8430-b1792bfb1554 1073741824 Feb 27 02:14:57 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:57 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Volume volume-85bc1183-6e6f-4099-bbd0-8a5c834ab92e (85bc1183-6e6f-4099-bbd0-8a5c834ab92e): created successfully Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c278259-dbd6-422c-ab85-6889b8faac00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Flow 'volume_create_manager' (ec1c8bef-640d-478c-9740-246f103e5de4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:57 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-1e88c857-8db0-48b3-b625-e1db6da0243f tempest-CreateVolumesFromSnapshotTest-283718236 None] Created volume successfully. Feb 27 02:14:57 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e047e364-ad42-44d3-a6cc-c85f17d2ad67 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.409s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-e047e364-ad42-44d3-a6cc-c85f17d2ad67 tempest-VolumeDependencyTests-1320295309 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:57 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e047e364-ad42-44d3-a6cc-c85f17d2ad67 tempest-VolumeDependencyTests-1320295309 None] Deleted volume successfully. Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e047e364-ad42-44d3-a6cc-c85f17d2ad67 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-ac4c03a6-a910-4226-8f91-e41f8569a8ce-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:57 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-182b1f98-bd99-4b93-8430-b1792bfb1554 1073741824" returned: 0 in 0.483s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:57 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-182b1f98-bd99-4b93-8430-b1792bfb1554 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:57 devstack sudo[90548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-182b1f98-bd99-4b93-8430-b1792bfb1554 Feb 27 02:14:57 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:58 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-182b1f98-bd99-4b93-8430-b1792bfb1554" returned: 0 in 0.428s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c61f4793-268f-4102-973a-6178efd12c1e tempest-SnapshotDependencyTests-1839279197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.208s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-c61f4793-268f-4102-973a-6178efd12c1e tempest-SnapshotDependencyTests-1839279197 None] Creating offline snapshot 676bfd51-c5d8-4158-8bc3-42088d337b18 of volume 3fbadee5-ccfc-4205-b17d-d1f1010378a0 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b9df5f-cd09-433c-9c7e-69e130d05b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-182b1f98-bd99-4b93-8430-b1792bfb1554', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1511d997-91c7-48a1-adf6-9174adab8db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[64377448-b017-4718-b754-be01e786138c]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c61f4793-268f-4102-973a-6178efd12c1e tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:58 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Volume volume-182b1f98-bd99-4b93-8430-b1792bfb1554 (182b1f98-bd99-4b93-8430-b1792bfb1554): created successfully Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1511d997-91c7-48a1-adf6-9174adab8db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Flow 'volume_create_manager' (5967bd9e-7d39-4c5e-adf1-80ac861a256a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:58 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-f830fecf-7741-4fe6-a728-cc9650a6219e tempest-CreateVolumesFromSnapshotTest-283718236 None] Created volume successfully. Feb 27 02:14:58 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 Feb 27 02:14:58 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Flow 'volume_create_manager' (65251d68-a3f6-465e-8f58-a098dcd39c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ac2891-f782-4d09-8da7-5f33b304e401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ac2891-f782-4d09-8da7-5f33b304e401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1367754600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8c5040-bdc3-46a4-9567-e5acdbb5f073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e9c25acf894684a65640a439a34935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:59Z,use_quota=True,user_id='f68a10659542415880ed4ce0d0c326df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75210155-7482-468f-98f0-f1a5186d2984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75210155-7482-468f-98f0-f1a5186d2984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71a7cb8-0dcb-4cae-a263-ef6e7641c002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71a7cb8-0dcb-4cae-a263-ef6e7641c002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f8c5040-bdc3-46a4-9567-e5acdbb5f073', 'volume_name': 'volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b90911b-15fb-4ea0-8c24-dfbc2121ef3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b90911b-15fb-4ea0-8c24-dfbc2121ef3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559191c7-7750-4566-9c32-ea7a7f9e4f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:58 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Volume 3f8c5040-bdc3-46a4-9567-e5acdbb5f073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073', 'volume_size': 1} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:58 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c61f4793-268f-4102-973a-6178efd12c1e tempest-SnapshotDependencyTests-1839279197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0" returned: 0 in 0.505s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:58 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c61f4793-268f-4102-973a-6178efd12c1e tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:58 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18 1G Feb 27 02:14:58 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:59 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:59 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b2eca74b-fbf1-4b33-81d1-ae49bb7389c1 tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "cinder-182b1f98-bd99-4b93-8430-b1792bfb1554-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c61f4793-268f-4102-973a-6178efd12c1e tempest-SnapshotDependencyTests-1839279197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18 1G" returned: 0 in 0.525s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c61f4793-268f-4102-973a-6178efd12c1e tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:59 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b2eca74b-fbf1-4b33-81d1-ae49bb7389c1 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-182b1f98-bd99-4b93-8430-b1792bfb1554-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:59 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18 Feb 27 02:14:59 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:59 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b2eca74b-fbf1-4b33-81d1-ae49bb7389c1 tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "cinder-quobyte-182b1f98-bd99-4b93-8430-b1792bfb1554" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:59 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b2eca74b-fbf1-4b33-81d1-ae49bb7389c1 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-quobyte-182b1f98-bd99-4b93-8430-b1792bfb1554" acquired by "delete_volume" :: waited 0.007s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:59 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbb28f6-efba-4bcb-94d3-cb4386a92518]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b2eca74b-fbf1-4b33-81d1-ae49bb7389c1 tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-182b1f98-bd99-4b93-8430-b1792bfb1554 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:59 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-182b1f98-bd99-4b93-8430-b1792bfb1554 Feb 27 02:14:59 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:59 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c61f4793-268f-4102-973a-6178efd12c1e tempest-SnapshotDependencyTests-1839279197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18" returned: 0 in 0.448s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:59 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-c61f4793-268f-4102-973a-6178efd12c1e tempest-SnapshotDependencyTests-1839279197 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18 is being set with open permissions: ugo+rw Feb 27 02:14:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c61f4793-268f-4102-973a-6178efd12c1e tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:59 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18 Feb 27 02:14:59 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:59 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b2eca74b-fbf1-4b33-81d1-ae49bb7389c1 tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-182b1f98-bd99-4b93-8430-b1792bfb1554" returned: 0 in 0.491s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:59 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b2eca74b-fbf1-4b33-81d1-ae49bb7389c1 tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-182b1f98-bd99-4b93-8430-b1792bfb1554 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:59 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-182b1f98-bd99-4b93-8430-b1792bfb1554 Feb 27 02:14:59 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:00 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c61f4793-268f-4102-973a-6178efd12c1e tempest-SnapshotDependencyTests-1839279197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18" returned: 0 in 0.416s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c61f4793-268f-4102-973a-6178efd12c1e tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:00 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.info Feb 27 02:15:00 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:00 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b2eca74b-fbf1-4b33-81d1-ae49bb7389c1 tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-182b1f98-bd99-4b93-8430-b1792bfb1554" returned: 0 in 0.403s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b2eca74b-fbf1-4b33-81d1-ae49bb7389c1 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-quobyte-182b1f98-bd99-4b93-8430-b1792bfb1554" released by "delete_volume" :: held 0.917s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-b2eca74b-fbf1-4b33-81d1-ae49bb7389c1 tempest-CreateVolumesFromSnapshotTest-283718236 None] Created reservations ['5451f7dd-f245-4fea-b527-b9e796d25876', '43640bab-c2bd-4f69-b67d-1f545c567306', '84298776-4d4e-4e15-9773-d4b81cc94136', '0387bd61-7849-4bbf-a7a1-857d8c27232b'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b2eca74b-fbf1-4b33-81d1-ae49bb7389c1 tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b2eca74b-fbf1-4b33-81d1-ae49bb7389c1 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b2eca74b-fbf1-4b33-81d1-ae49bb7389c1 tempest-CreateVolumesFromSnapshotTest-283718236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-b2eca74b-fbf1-4b33-81d1-ae49bb7389c1 tempest-CreateVolumesFromSnapshotTest-283718236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-b2eca74b-fbf1-4b33-81d1-ae49bb7389c1 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b2eca74b-fbf1-4b33-81d1-ae49bb7389c1 tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:00 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:15:00 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f34715db-50e3-4a2f-aea4-863eb18805ad tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "cinder-85bc1183-6e6f-4099-bbd0-8a5c834ab92e-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f34715db-50e3-4a2f-aea4-863eb18805ad tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-85bc1183-6e6f-4099-bbd0-8a5c834ab92e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f34715db-50e3-4a2f-aea4-863eb18805ad tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "cinder-quobyte-85bc1183-6e6f-4099-bbd0-8a5c834ab92e" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f34715db-50e3-4a2f-aea4-863eb18805ad tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-quobyte-85bc1183-6e6f-4099-bbd0-8a5c834ab92e" acquired by "delete_volume" :: waited 0.021s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[25490669-20dc-46e9-a778-2d3ab3c060c9]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f34715db-50e3-4a2f-aea4-863eb18805ad tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-85bc1183-6e6f-4099-bbd0-8a5c834ab92e {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:00 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-85bc1183-6e6f-4099-bbd0-8a5c834ab92e Feb 27 02:15:00 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:00 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c61f4793-268f-4102-973a-6178efd12c1e tempest-SnapshotDependencyTests-1839279197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.info" returned: 0 in 0.468s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:00 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-c61f4793-268f-4102-973a-6178efd12c1e tempest-SnapshotDependencyTests-1839279197 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.info is being set with open permissions: ugo+rw Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c61f4793-268f-4102-973a-6178efd12c1e tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:00 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.info Feb 27 02:15:00 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:00 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-b2eca74b-fbf1-4b33-81d1-ae49bb7389c1 tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.446s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-b2eca74b-fbf1-4b33-81d1-ae49bb7389c1 tempest-CreateVolumesFromSnapshotTest-283718236 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:15:00 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-b2eca74b-fbf1-4b33-81d1-ae49bb7389c1 tempest-CreateVolumesFromSnapshotTest-283718236 None] Deleted volume successfully. Feb 27 02:15:00 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-b2eca74b-fbf1-4b33-81d1-ae49bb7389c1 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-182b1f98-bd99-4b93-8430-b1792bfb1554-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:01 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f34715db-50e3-4a2f-aea4-863eb18805ad tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-85bc1183-6e6f-4099-bbd0-8a5c834ab92e" returned: 0 in 0.519s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f34715db-50e3-4a2f-aea4-863eb18805ad tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-85bc1183-6e6f-4099-bbd0-8a5c834ab92e {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:01 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-85bc1183-6e6f-4099-bbd0-8a5c834ab92e Feb 27 02:15:01 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:01 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c61f4793-268f-4102-973a-6178efd12c1e tempest-SnapshotDependencyTests-1839279197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.info" returned: 0 in 0.413s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c61f4793-268f-4102-973a-6178efd12c1e tempest-SnapshotDependencyTests-1839279197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.843s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.714s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-587353214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a345b7a3-c182-47b4-a8f7-fed2433a9f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4375a68889d449d38e95c4f1e0882515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:54Z,use_quota=True,user_id='fe099c2c6d684376993e0d9e37180656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Creating volume a345b7a3-c182-47b4-a8f7-fed2433a9f11 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:15:01 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a345b7a3-c182-47b4-a8f7-fed2433a9f11 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:01 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a345b7a3-c182-47b4-a8f7-fed2433a9f11 1073741824 Feb 27 02:15:01 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:01 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-c61f4793-268f-4102-973a-6178efd12c1e tempest-SnapshotDependencyTests-1839279197 None] Create snapshot completed successfully Feb 27 02:15:01 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f34715db-50e3-4a2f-aea4-863eb18805ad tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-85bc1183-6e6f-4099-bbd0-8a5c834ab92e" returned: 0 in 0.503s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f34715db-50e3-4a2f-aea4-863eb18805ad tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-quobyte-85bc1183-6e6f-4099-bbd0-8a5c834ab92e" released by "delete_volume" :: held 1.047s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-f34715db-50e3-4a2f-aea4-863eb18805ad tempest-CreateVolumesFromSnapshotTest-283718236 None] Created reservations ['bf00f413-8acc-4e5c-a171-848199ded60a', 'df00a6ef-0607-4c38-a17a-7fe8ee68cb18', '01415440-aa6c-4988-8090-585ec510b927', 'b0cf8316-0272-4fca-abf4-458d3fc93cb8'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:15:01 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Flow 'volume_create_manager' (91ad418f-57c4-48a5-b69d-5aec5058788d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6968ae49-91dd-4a86-91ef-6011c701e7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6968ae49-91dd-4a86-91ef-6011c701e7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482ac752-b81c-403e-8212-6726d22ebd07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1890bbba76e7440b8edcdfc97c8048ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=676bfd51-c5d8-4158-8bc3-42088d337b18,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:15:02Z,use_quota=True,user_id='e041380ba53245d8ba7b4b9bd1c33038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17b7c17c-9cc4-4ba8-9333-72c17eef4eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17b7c17c-9cc4-4ba8-9333-72c17eef4eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a68f474-8282-487f-a539-a59ad0685051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a68f474-8282-487f-a539-a59ad0685051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '482ac752-b81c-403e-8212-6726d22ebd07', 'volume_name': 'volume-482ac752-b81c-403e-8212-6726d22ebd07', 'volume_size': 1, 'snapshot_id': '676bfd51-c5d8-4158-8bc3-42088d337b18'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64c7c7d-cb45-430c-90de-ce714ce1f6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64c7c7d-cb45-430c-90de-ce714ce1f6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506a6153-82c1-4d2b-a03b-52da74cb7472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:01 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Volume 482ac752-b81c-403e-8212-6726d22ebd07: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-482ac752-b81c-403e-8212-6726d22ebd07', 'volume_size': 1, 'snapshot_id': '676bfd51-c5d8-4158-8bc3-42088d337b18'} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a345b7a3-c182-47b4-a8f7-fed2433a9f11 1073741824" returned: 0 in 0.595s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a345b7a3-c182-47b4-a8f7-fed2433a9f11 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f34715db-50e3-4a2f-aea4-863eb18805ad tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f34715db-50e3-4a2f-aea4-863eb18805ad tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f34715db-50e3-4a2f-aea4-863eb18805ad tempest-CreateVolumesFromSnapshotTest-283718236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-f34715db-50e3-4a2f-aea4-863eb18805ad tempest-CreateVolumesFromSnapshotTest-283718236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-f34715db-50e3-4a2f-aea4-863eb18805ad tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:01 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f34715db-50e3-4a2f-aea4-863eb18805ad tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:01 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a345b7a3-c182-47b4-a8f7-fed2433a9f11 Feb 27 02:15:01 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:01 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:15:01 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:02 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-f34715db-50e3-4a2f-aea4-863eb18805ad tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.384s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-f34715db-50e3-4a2f-aea4-863eb18805ad tempest-CreateVolumesFromSnapshotTest-283718236 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:15:02 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-f34715db-50e3-4a2f-aea4-863eb18805ad tempest-CreateVolumesFromSnapshotTest-283718236 None] Deleted volume successfully. Feb 27 02:15:02 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a345b7a3-c182-47b4-a8f7-fed2433a9f11" returned: 0 in 0.413s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.460s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1367754600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8c5040-bdc3-46a4-9567-e5acdbb5f073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e9c25acf894684a65640a439a34935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:59Z,use_quota=True,user_id='f68a10659542415880ed4ce0d0c326df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Creating volume 3f8c5040-bdc3-46a4-9567-e5acdbb5f073 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:15:02 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde1e28d-71ca-4a80-9856-5ef34d0ccaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a345b7a3-c182-47b4-a8f7-fed2433a9f11', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de701af1-7b24-41b8-9d5c-6495bfcbda0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:02 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 1073741824 Feb 27 02:15:02 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-f34715db-50e3-4a2f-aea4-863eb18805ad tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-85bc1183-6e6f-4099-bbd0-8a5c834ab92e-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:02 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Volume volume-a345b7a3-c182-47b4-a8f7-fed2433a9f11 (a345b7a3-c182-47b4-a8f7-fed2433a9f11): created successfully Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de701af1-7b24-41b8-9d5c-6495bfcbda0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Flow 'volume_create_manager' (a975d8d3-fa0a-4335-ab91-5b3e87b3bff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:15:02 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-9c95a7e8-a988-4aa1-a333-42ea47572e08 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Created volume successfully. Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-91d0d677-197d-45ac-a769-568c7dced67c tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "cinder-2209db73-259d-48be-bdd3-7ba8bfc72db4-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-91d0d677-197d-45ac-a769-568c7dced67c tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-2209db73-259d-48be-bdd3-7ba8bfc72db4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:02 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 1073741824" returned: 0 in 0.499s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-91d0d677-197d-45ac-a769-568c7dced67c tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "cinder-quobyte-2209db73-259d-48be-bdd3-7ba8bfc72db4" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-91d0d677-197d-45ac-a769-568c7dced67c tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-quobyte-2209db73-259d-48be-bdd3-7ba8bfc72db4" acquired by "delete_volume" :: waited 0.023s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:02 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 Feb 27 02:15:02 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[594c9f7f-18e0-4624-9691-2c2379c24e34]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-91d0d677-197d-45ac-a769-568c7dced67c tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2209db73-259d-48be-bdd3-7ba8bfc72db4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:02 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2209db73-259d-48be-bdd3-7ba8bfc72db4 Feb 27 02:15:02 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:15:02 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Flow 'volume_create_manager' (b189efd1-320c-48e9-be5c-f0225b7f6455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61129de8-3acf-41c4-bfce-e06ff4a1874f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61129de8-3acf-41c4-bfce-e06ff4a1874f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-596363283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4375a68889d449d38e95c4f1e0882515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:15:03Z,use_quota=True,user_id='fe099c2c6d684376993e0d9e37180656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6f56d9b-f68a-4d15-aa5f-58bd80d69fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6f56d9b-f68a-4d15-aa5f-58bd80d69fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11bdfc3d-39a7-4f1e-8aaa-a76e94090833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11bdfc3d-39a7-4f1e-8aaa-a76e94090833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b', 'volume_name': 'volume-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84487dd-5d9b-49e8-8274-88a44bbb2341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84487dd-5d9b-49e8-8274-88a44bbb2341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35895a5b-a7f5-4662-bd3d-3bea14c18fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Volume 4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b', 'volume_size': 1} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:03 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073" returned: 0 in 0.450s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.428s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Acquiring lock "cinder-quobyte-676bfd51-c5d8-4158-8bc3-42088d337b18-482ac752-b81c-403e-8212-6726d22ebd07" by "_create_volume_from_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Lock "cinder-quobyte-676bfd51-c5d8-4158-8bc3-42088d337b18-482ac752-b81c-403e-8212-6726d22ebd07" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Creating volume 482ac752-b81c-403e-8212-6726d22ebd07 from snapshot 676bfd51-c5d8-4158-8bc3-42088d337b18 {{(pid=82738) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Acquiring lock "cinder-quobyte-482ac752-b81c-403e-8212-6726d22ebd07" by "_copy_volume_from_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559191c7-7750-4566-9c32-ea7a7f9e4f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e697a6e-6061-4d0f-b62c-61994778007d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Lock "cinder-quobyte-482ac752-b81c-403e-8212-6726d22ebd07" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] snapshot: 676bfd51-c5d8-4158-8bc3-42088d337b18, volume: 482ac752-b81c-403e-8212-6726d22ebd07, {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:15:03 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Volume volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 (3f8c5040-bdc3-46a4-9567-e5acdbb5f073): created successfully Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e697a6e-6061-4d0f-b62c-61994778007d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Flow 'volume_create_manager' (65251d68-a3f6-465e-8f58-a098dcd39c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b91a23-3c01-4e0b-ac51-3d7bfdd9cb20]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:03 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-35f6c12c-81bd-43a0-8460-4ceabb247da6 tempest-VolumeDependencyTests-1320295309 None] Created volume successfully. Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:15:03 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Flow 'volume_create_manager' (f06ba79f-e515-4f1e-b95f-7901a45ceb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4fb32b-d07b-474a-8b0d-04174e40e229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-91d0d677-197d-45ac-a769-568c7dced67c tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2209db73-259d-48be-bdd3-7ba8bfc72db4" returned: 0 in 0.593s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-91d0d677-197d-45ac-a769-568c7dced67c tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2209db73-259d-48be-bdd3-7ba8bfc72db4 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4fb32b-d07b-474a-8b0d-04174e40e229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-984532704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18054895-2e42-42b8-bbec-f98413221efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4375a68889d449d38e95c4f1e0882515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:15:03Z,use_quota=True,user_id='fe099c2c6d684376993e0d9e37180656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2209db73-259d-48be-bdd3-7ba8bfc72db4 Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acbb0f2-be7c-4135-8968-63ab80ebcb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acbb0f2-be7c-4135-8968-63ab80ebcb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1383fd27-9044-4e25-873a-861c784a5d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1383fd27-9044-4e25-873a-861c784a5d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18054895-2e42-42b8-bbec-f98413221efc', 'volume_name': 'volume-18054895-2e42-42b8-bbec-f98413221efc', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c1ed9a8-2b08-439a-8581-8b3fb73e96e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c1ed9a8-2b08-439a-8581-8b3fb73e96e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d869bbfb-2a16-44f2-93d8-3f6f499797fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Volume 18054895-2e42-42b8-bbec-f98413221efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18054895-2e42-42b8-bbec-f98413221efc', 'volume_size': 1} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:03 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18 Feb 27 02:15:03 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Flow 'volume_create_manager' (279589a8-15dd-450e-b9bc-ceda8665f895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a062bc-f30b-47f8-a13d-ab5d01cbb739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a062bc-f30b-47f8-a13d-ab5d01cbb739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-230356758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3785ce-2af2-4a0a-b6fb-b9530a83420b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4375a68889d449d38e95c4f1e0882515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:15:03Z,use_quota=True,user_id='fe099c2c6d684376993e0d9e37180656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b19b2f-cde4-4d68-aead-c4f15f796fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b19b2f-cde4-4d68-aead-c4f15f796fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15561b3b-ed3d-4d7b-a56f-3ae9e5423230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15561b3b-ed3d-4d7b-a56f-3ae9e5423230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b3785ce-2af2-4a0a-b6fb-b9530a83420b', 'volume_name': 'volume-4b3785ce-2af2-4a0a-b6fb-b9530a83420b', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ad8de2-176a-4f51-9b4b-50b7b2213942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ad8de2-176a-4f51-9b4b-50b7b2213942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c3c607-7b50-4224-8af3-a1cc95f865f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Volume 4b3785ce-2af2-4a0a-b6fb-b9530a83420b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b3785ce-2af2-4a0a-b6fb-b9530a83420b', 'volume_size': 1} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Flow 'volume_create_manager' (408937a9-af95-45dc-a1fb-32f057e558f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6758a8e7-d836-4f49-a756-d13ed57e7e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6758a8e7-d836-4f49-a756-d13ed57e7e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-934738252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89ed250-f4bf-4ae4-b5f9-d38aaff4da02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4375a68889d449d38e95c4f1e0882515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:15:04Z,use_quota=True,user_id='fe099c2c6d684376993e0d9e37180656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e39a83c-0f5a-4205-b652-95f88a846f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e39a83c-0f5a-4205-b652-95f88a846f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d9477c-81ad-4df4-acaf-d599afeb53ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d9477c-81ad-4df4-acaf-d599afeb53ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a89ed250-f4bf-4ae4-b5f9-d38aaff4da02', 'volume_name': 'volume-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aaea6af-6a84-478c-9a68-78b0cb7fc3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aaea6af-6a84-478c-9a68-78b0cb7fc3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e4a9c3-4061-47ec-9eaa-0d90a178f3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Volume a89ed250-f4bf-4ae4-b5f9-d38aaff4da02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02', 'volume_size': 1} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:03 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-91d0d677-197d-45ac-a769-568c7dced67c tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-2209db73-259d-48be-bdd3-7ba8bfc72db4" returned: 0 in 0.491s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-91d0d677-197d-45ac-a769-568c7dced67c tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-quobyte-2209db73-259d-48be-bdd3-7ba8bfc72db4" released by "delete_volume" :: held 1.111s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:03 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18" returned: 0 in 0.569s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Creating direct copy from snapshot {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[76acf947-0b61-4ca7-9fab-6f9cd8e2b748]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-91d0d677-197d-45ac-a769-568c7dced67c tempest-CreateVolumesFromSnapshotTest-283718236 None] Created reservations ['b4e79a05-52af-4a93-946a-2419dca6e0e9', '03771193-1bae-43c8-97dc-3244090d4c36', '1fc28a0c-4666-4099-a1e7-c143645bf573', '170e90c4-7944-4ccc-938e-8dec3dd34317'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Flow 'volume_create_manager' (1ed46082-b0e6-4f2f-8ea9-e0e54ed1548a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3827b57e-67bf-454c-8a81-7c1b9edba324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 Feb 27 02:15:03 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3827b57e-67bf-454c-8a81-7c1b9edba324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2005001907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8531af0-2b12-4a4f-a97e-b02dbbc887aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4375a68889d449d38e95c4f1e0882515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:15:04Z,use_quota=True,user_id='fe099c2c6d684376993e0d9e37180656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585a29fe-3bd1-4fcb-9af3-5916669189c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585a29fe-3bd1-4fcb-9af3-5916669189c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebeb70a9-ad45-4ac5-b634-225d4f07a80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebeb70a9-ad45-4ac5-b634-225d4f07a80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8531af0-2b12-4a4f-a97e-b02dbbc887aa', 'volume_name': 'volume-e8531af0-2b12-4a4f-a97e-b02dbbc887aa', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f9ea9d-0444-450c-896b-cc76aac3218c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f9ea9d-0444-450c-896b-cc76aac3218c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af545941-de58-4364-82af-8f283b5e5e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:03 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Volume e8531af0-2b12-4a4f-a97e-b02dbbc887aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8531af0-2b12-4a4f-a97e-b02dbbc887aa', 'volume_size': 1} Feb 27 02:15:03 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-91d0d677-197d-45ac-a769-568c7dced67c tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-91d0d677-197d-45ac-a769-568c7dced67c tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-91d0d677-197d-45ac-a769-568c7dced67c tempest-CreateVolumesFromSnapshotTest-283718236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-91d0d677-197d-45ac-a769-568c7dced67c tempest-CreateVolumesFromSnapshotTest-283718236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-91d0d677-197d-45ac-a769-568c7dced67c tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-91d0d677-197d-45ac-a769-568c7dced67c tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:04 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:15:04 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Flow 'volume_create_manager' (f08978c2-aed8-424e-8203-80cf8b8ea3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2507ee7a-222b-47b3-a7e1-a5eddca49090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2507ee7a-222b-47b3-a7e1-a5eddca49090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1015151881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364d199e-f899-4aa6-ab01-f9e6f5b6e041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e9c25acf894684a65640a439a34935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3f8c5040-bdc3-46a4-9567-e5acdbb5f073,status='creating',terminated_at=None,updated_at=2026-02-27T01:15:04Z,use_quota=True,user_id='f68a10659542415880ed4ce0d0c326df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e8c33d-511a-49d4-b74d-50abe38f42d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e8c33d-511a-49d4-b74d-50abe38f42d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a96283-7488-4b36-9f4c-c3e1d19963dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a96283-7488-4b36-9f4c-c3e1d19963dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '364d199e-f899-4aa6-ab01-f9e6f5b6e041', 'volume_name': 'volume-364d199e-f899-4aa6-ab01-f9e6f5b6e041', 'volume_size': 1, 'source_volid': '3f8c5040-bdc3-46a4-9567-e5acdbb5f073', 'source_volstatus': 'available'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd875aa-2467-41c1-9e02-5db4a5f32ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd875aa-2467-41c1-9e02-5db4a5f32ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (221e2ef7-cd08-4dd1-8ff3-363d71650e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:04 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Volume 364d199e-f899-4aa6-ab01-f9e6f5b6e041: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-364d199e-f899-4aa6-ab01-f9e6f5b6e041', 'volume_size': 1, 'source_volid': '3f8c5040-bdc3-46a4-9567-e5acdbb5f073', 'source_volstatus': 'available'} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:04 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0" returned: 0 in 0.608s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG cinder.utils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Path /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-482ac752-b81c-403e-8212-6726d22ebd07 not found in is_blk_device check {{(pid=82738) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-482ac752-b81c-403e-8212-6726d22ebd07 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:04 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-482ac752-b81c-403e-8212-6726d22ebd07 Feb 27 02:15:04 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:04 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-91d0d677-197d-45ac-a769-568c7dced67c tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.449s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-91d0d677-197d-45ac-a769-568c7dced67c tempest-CreateVolumesFromSnapshotTest-283718236 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:15:04 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-91d0d677-197d-45ac-a769-568c7dced67c tempest-CreateVolumesFromSnapshotTest-283718236 None] Deleted volume successfully. Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-91d0d677-197d-45ac-a769-568c7dced67c tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-2209db73-259d-48be-bdd3-7ba8bfc72db4-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-641fd909-73a2-4756-9a3c-16453e39722d tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "cinder-8edef8a0-d8c3-4081-87ef-0518173d6f43-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-641fd909-73a2-4756-9a3c-16453e39722d tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-8edef8a0-d8c3-4081-87ef-0518173d6f43-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-641fd909-73a2-4756-9a3c-16453e39722d tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "cinder-quobyte-8edef8a0-d8c3-4081-87ef-0518173d6f43" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-641fd909-73a2-4756-9a3c-16453e39722d tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-quobyte-8edef8a0-d8c3-4081-87ef-0518173d6f43" acquired by "delete_volume" :: waited 0.016s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc401fc4-1851-4e7f-aca0-a9cb90f15e30]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:04 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-641fd909-73a2-4756-9a3c-16453e39722d tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8edef8a0-d8c3-4081-87ef-0518173d6f43 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:05 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8edef8a0-d8c3-4081-87ef-0518173d6f43 Feb 27 02:15:05 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:06 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-641fd909-73a2-4756-9a3c-16453e39722d tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8edef8a0-d8c3-4081-87ef-0518173d6f43" returned: 0 in 1.638s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-641fd909-73a2-4756-9a3c-16453e39722d tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8edef8a0-d8c3-4081-87ef-0518173d6f43 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:06 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8edef8a0-d8c3-4081-87ef-0518173d6f43 Feb 27 02:15:06 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:06 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-482ac752-b81c-403e-8212-6726d22ebd07" returned: 0 in 2.159s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:06 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[38850b29-cac2-46ca-bb4c-53e8676493fc]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:06 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 Feb 27 02:15:06 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:06 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:06 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-641fd909-73a2-4756-9a3c-16453e39722d tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-8edef8a0-d8c3-4081-87ef-0518173d6f43" returned: 0 in 0.391s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:06 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-641fd909-73a2-4756-9a3c-16453e39722d tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-quobyte-8edef8a0-d8c3-4081-87ef-0518173d6f43" released by "delete_volume" :: held 2.064s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-641fd909-73a2-4756-9a3c-16453e39722d tempest-CreateVolumesFromSnapshotTest-283718236 None] Created reservations ['b9f11369-26f5-4655-9d96-1692bb25a4b8', '3eff1bd9-9d12-47eb-aff5-8f3fe816bb73', '33ddc47d-a44b-4a38-867f-eeea677516be', '89a1caa4-549a-4ca7-a882-d4f352293397'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-641fd909-73a2-4756-9a3c-16453e39722d tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-641fd909-73a2-4756-9a3c-16453e39722d tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-641fd909-73a2-4756-9a3c-16453e39722d tempest-CreateVolumesFromSnapshotTest-283718236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-641fd909-73a2-4756-9a3c-16453e39722d tempest-CreateVolumesFromSnapshotTest-283718236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-641fd909-73a2-4756-9a3c-16453e39722d tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-641fd909-73a2-4756-9a3c-16453e39722d tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:07 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:15:07 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e7403bd6-070d-442f-b624-af982d0c7ddd tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "cinder-222ee42c-8561-4a4b-baa3-b086ae5de9b7-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e7403bd6-070d-442f-b624-af982d0c7ddd tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-222ee42c-8561-4a4b-baa3-b086ae5de9b7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e7403bd6-070d-442f-b624-af982d0c7ddd tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "cinder-quobyte-222ee42c-8561-4a4b-baa3-b086ae5de9b7" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:07 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e7403bd6-070d-442f-b624-af982d0c7ddd tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-quobyte-222ee42c-8561-4a4b-baa3-b086ae5de9b7" acquired by "delete_volume" :: waited 0.008s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0" returned: 0 in 0.610s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-482ac752-b81c-403e-8212-6726d22ebd07 {{(pid=82738) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:15:07 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Converted 1024.00 MB image at 474.05 MB/s Feb 27 02:15:07 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-482ac752-b81c-403e-8212-6726d22ebd07 is being set with open permissions: ugo+rw Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-482ac752-b81c-403e-8212-6726d22ebd07 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c378c6-331f-455d-a8bb-75a8ace9e821]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e7403bd6-070d-442f-b624-af982d0c7ddd tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-222ee42c-8561-4a4b-baa3-b086ae5de9b7 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:07 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-482ac752-b81c-403e-8212-6726d22ebd07 Feb 27 02:15:07 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:07 devstack sudo[90665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-222ee42c-8561-4a4b-baa3-b086ae5de9b7 Feb 27 02:15:07 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:07 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-641fd909-73a2-4756-9a3c-16453e39722d tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.437s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-641fd909-73a2-4756-9a3c-16453e39722d tempest-CreateVolumesFromSnapshotTest-283718236 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:15:07 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-641fd909-73a2-4756-9a3c-16453e39722d tempest-CreateVolumesFromSnapshotTest-283718236 None] Deleted volume successfully. Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-641fd909-73a2-4756-9a3c-16453e39722d tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-8edef8a0-d8c3-4081-87ef-0518173d6f43-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:07 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-482ac752-b81c-403e-8212-6726d22ebd07" returned: 0 in 0.436s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Lock "cinder-quobyte-482ac752-b81c-403e-8212-6726d22ebd07" released by "_copy_volume_from_snapshot" :: held 4.469s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Lock "cinder-quobyte-676bfd51-c5d8-4158-8bc3-42088d337b18-482ac752-b81c-403e-8212-6726d22ebd07" released by "_create_volume_from_snapshot" :: held 4.506s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.521s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.633s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-596363283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4375a68889d449d38e95c4f1e0882515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:15:03Z,use_quota=True,user_id='fe099c2c6d684376993e0d9e37180656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Creating volume 4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:15:07 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:07 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:07 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b 1073741824 Feb 27 02:15:07 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e7403bd6-070d-442f-b624-af982d0c7ddd tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-222ee42c-8561-4a4b-baa3-b086ae5de9b7" returned: 0 in 0.468s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e7403bd6-070d-442f-b624-af982d0c7ddd tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-222ee42c-8561-4a4b-baa3-b086ae5de9b7 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506a6153-82c1-4d2b-a03b-52da74cb7472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-482ac752-b81c-403e-8212-6726d22ebd07', 'volume_size': 1, 'snapshot_id': '676bfd51-c5d8-4158-8bc3-42088d337b18'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7940f276-9b82-4705-be90-6d1ff658e90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:07 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-222ee42c-8561-4a4b-baa3-b086ae5de9b7 Feb 27 02:15:07 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:07 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Volume volume-482ac752-b81c-403e-8212-6726d22ebd07 (482ac752-b81c-403e-8212-6726d22ebd07): created successfully Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7940f276-9b82-4705-be90-6d1ff658e90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:07 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Flow 'volume_create_manager' (91ad418f-57c4-48a5-b69d-5aec5058788d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:15:07 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-0166434d-ade9-4bf2-8b6b-64e5ab23ea51 tempest-SnapshotDependencyTests-1839279197 None] Created volume successfully. Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] Acquiring lock "cinder-676bfd51-c5d8-4158-8bc3-42088d337b18-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] Lock "cinder-676bfd51-c5d8-4158-8bc3-42088d337b18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] Acquiring lock "cinder-quobyte-3fbadee5-ccfc-4205-b17d-d1f1010378a0" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] Lock "cinder-quobyte-3fbadee5-ccfc-4205-b17d-d1f1010378a0" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] Acquiring lock "cinder-quobyte-676bfd51-c5d8-4158-8bc3-42088d337b18" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] Lock "cinder-quobyte-676bfd51-c5d8-4158-8bc3-42088d337b18" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] Deleting offline snapshot 676bfd51-c5d8-4158-8bc3-42088d337b18 of volume 3fbadee5-ccfc-4205-b17d-d1f1010378a0 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] snapshot_file for this snap is: volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d8576b-0c13-4d96-b95c-2cb0cf103f32]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:08 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e7403bd6-070d-442f-b624-af982d0c7ddd tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-222ee42c-8561-4a4b-baa3-b086ae5de9b7" returned: 0 in 0.434s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e7403bd6-070d-442f-b624-af982d0c7ddd tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-quobyte-222ee42c-8561-4a4b-baa3-b086ae5de9b7" released by "delete_volume" :: held 0.941s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:08 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18 Feb 27 02:15:08 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-e7403bd6-070d-442f-b624-af982d0c7ddd tempest-CreateVolumesFromSnapshotTest-283718236 None] Created reservations ['e3fea671-0f4c-4149-af5b-a6745763630b', 'ef7db05c-a10f-4a02-917d-5eafed83c1c1', '2826e24f-1919-45a3-aae2-cba4f4007d92', 'faa8b854-9dba-4ff3-9ccf-681dcc3ebd5e'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:08 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b 1073741824" returned: 0 in 0.516s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e7403bd6-070d-442f-b624-af982d0c7ddd tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e7403bd6-070d-442f-b624-af982d0c7ddd tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e7403bd6-070d-442f-b624-af982d0c7ddd tempest-CreateVolumesFromSnapshotTest-283718236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-e7403bd6-070d-442f-b624-af982d0c7ddd tempest-CreateVolumesFromSnapshotTest-283718236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-e7403bd6-070d-442f-b624-af982d0c7ddd tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e7403bd6-070d-442f-b624-af982d0c7ddd tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:08 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:15:08 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:08 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b Feb 27 02:15:08 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "cinder-569d91fd-00b4-4a4a-8416-23ae1f398031-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-569d91fd-00b4-4a4a-8416-23ae1f398031-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "cinder-quobyte-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-quobyte-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "cinder-quobyte-569d91fd-00b4-4a4a-8416-23ae1f398031" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-quobyte-569d91fd-00b4-4a4a-8416-23ae1f398031" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] Deleting offline snapshot 569d91fd-00b4-4a4a-8416-23ae1f398031 of volume d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] snapshot_file for this snap is: volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.569d91fd-00b4-4a4a-8416-23ae1f398031 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd48cabb-a84e-4928-a99d-c22d0a8b21a8]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.569d91fd-00b4-4a4a-8416-23ae1f398031 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:08 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.569d91fd-00b4-4a4a-8416-23ae1f398031 Feb 27 02:15:08 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:08 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18" returned: 0 in 0.547s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e2acbd-3fbc-4c98-9f99-445b53e3c135]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:08 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-e7403bd6-070d-442f-b624-af982d0c7ddd tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.436s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-e7403bd6-070d-442f-b624-af982d0c7ddd tempest-CreateVolumesFromSnapshotTest-283718236 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:15:08 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-e7403bd6-070d-442f-b624-af982d0c7ddd tempest-CreateVolumesFromSnapshotTest-283718236 None] Deleted volume successfully. Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-e7403bd6-070d-442f-b624-af982d0c7ddd tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-222ee42c-8561-4a4b-baa3-b086ae5de9b7-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:08 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b" returned: 0 in 0.462s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.360s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-984532704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18054895-2e42-42b8-bbec-f98413221efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4375a68889d449d38e95c4f1e0882515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:15:03Z,use_quota=True,user_id='fe099c2c6d684376993e0d9e37180656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Creating volume 18054895-2e42-42b8-bbec-f98413221efc {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:15:08 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-18054895-2e42-42b8-bbec-f98413221efc 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:08 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 Feb 27 02:15:08 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35895a5b-a7f5-4662-bd3d-3bea14c18fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:08 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-18054895-2e42-42b8-bbec-f98413221efc 1073741824 Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bb1bd2-6123-4622-9280-2b5ee7160aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:08 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:08 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Volume volume-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b (4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b): created successfully Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bb1bd2-6123-4622-9280-2b5ee7160aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Flow 'volume_create_manager' (b189efd1-320c-48e9-be5c-f0225b7f6455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:15:08 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-fc95b10b-9833-48f2-929d-46cbeb5dd5d2 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Created volume successfully. Feb 27 02:15:08 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.569d91fd-00b4-4a4a-8416-23ae1f398031" returned: 0 in 0.486s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02a871c-d686-4140-82cd-4f00a9bd4010]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:08 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:08 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf Feb 27 02:15:08 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:09 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0" returned: 0 in 0.512s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:09 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18 Feb 27 02:15:09 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:09 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-18054895-2e42-42b8-bbec-f98413221efc 1073741824" returned: 0 in 0.522s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-18054895-2e42-42b8-bbec-f98413221efc {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:09 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-18054895-2e42-42b8-bbec-f98413221efc Feb 27 02:15:09 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:09 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf" returned: 0 in 0.562s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.569d91fd-00b4-4a4a-8416-23ae1f398031 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:09 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.569d91fd-00b4-4a4a-8416-23ae1f398031 Feb 27 02:15:09 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:09 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18" returned: 0 in 0.494s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:09 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18 Feb 27 02:15:09 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:09 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-18054895-2e42-42b8-bbec-f98413221efc" returned: 0 in 0.444s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.249s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-230356758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3785ce-2af2-4a0a-b6fb-b9530a83420b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4375a68889d449d38e95c4f1e0882515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:15:03Z,use_quota=True,user_id='fe099c2c6d684376993e0d9e37180656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Creating volume 4b3785ce-2af2-4a0a-b6fb-b9530a83420b {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:15:09 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4b3785ce-2af2-4a0a-b6fb-b9530a83420b 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d869bbfb-2a16-44f2-93d8-3f6f499797fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18054895-2e42-42b8-bbec-f98413221efc', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:09 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4b3785ce-2af2-4a0a-b6fb-b9530a83420b 1073741824 Feb 27 02:15:09 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9ce9ef-6433-418a-84ba-0ea5849ebb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:09 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Volume volume-18054895-2e42-42b8-bbec-f98413221efc (18054895-2e42-42b8-bbec-f98413221efc): created successfully Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9ce9ef-6433-418a-84ba-0ea5849ebb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Flow 'volume_create_manager' (f06ba79f-e515-4f1e-b95f-7901a45ceb32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:15:09 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-396a9c9b-e28c-4de2-b34f-133b969fab7f tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Created volume successfully. Feb 27 02:15:09 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.569d91fd-00b4-4a4a-8416-23ae1f398031" returned: 0 in 0.448s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:09 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.569d91fd-00b4-4a4a-8416-23ae1f398031 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:09 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.569d91fd-00b4-4a4a-8416-23ae1f398031 Feb 27 02:15:09 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:10 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0.676bfd51-c5d8-4158-8bc3-42088d337b18" returned: 0 in 0.464s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] Lock "cinder-quobyte-676bfd51-c5d8-4158-8bc3-42088d337b18" released by "_delete_snapshot" :: held 2.082s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] Lock "cinder-quobyte-3fbadee5-ccfc-4205-b17d-d1f1010378a0" released by "delete_snapshot" :: held 2.096s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] Created reservations ['d20d65ea-542e-4195-9302-d14358bcced1', 'b48ecf2e-3f58-4a33-a589-be7ffd87809e', '7b5a3aa9-cfab-4c8d-b7bf-97606fb933d4', '2c8e1acf-d79c-468b-81e5-74125d16283d'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:10 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:10 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] Delete snapshot completed successfully. Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4b3785ce-2af2-4a0a-b6fb-b9530a83420b 1073741824" returned: 0 in 0.503s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d8293908-a024-4d6f-8c15-4d90cafff78c tempest-SnapshotDependencyTests-1839279197 None] Lock "cinder-676bfd51-c5d8-4158-8bc3-42088d337b18-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4b3785ce-2af2-4a0a-b6fb-b9530a83420b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:10 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4b3785ce-2af2-4a0a-b6fb-b9530a83420b Feb 27 02:15:10 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:10 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf.569d91fd-00b4-4a4a-8416-23ae1f398031" returned: 0 in 0.432s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-quobyte-569d91fd-00b4-4a4a-8416-23ae1f398031" released by "_delete_snapshot" :: held 1.982s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-quobyte-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf" released by "delete_snapshot" :: held 1.996s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] Created reservations ['7f7f367d-bd9b-44e0-904c-ee0af051efd9', 'eb5061f5-1a30-4c2a-95b6-09ebf0e142f9', '6416d2dc-a128-4b29-94c4-54f1e670ca9c', '8fdc129b-91da-46ac-a0c5-e702249b75ba'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:10 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] Delete snapshot completed successfully. Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-15ac753f-7be9-4a0d-9278-a7ede2a79faa tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-569d91fd-00b4-4a4a-8416-23ae1f398031-delete_snapshot" released by "delete_snapshot" :: held 2.083s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:10 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4b3785ce-2af2-4a0a-b6fb-b9530a83420b" returned: 0 in 0.447s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.017s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-934738252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89ed250-f4bf-4ae4-b5f9-d38aaff4da02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4375a68889d449d38e95c4f1e0882515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:15:04Z,use_quota=True,user_id='fe099c2c6d684376993e0d9e37180656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Creating volume a89ed250-f4bf-4ae4-b5f9-d38aaff4da02 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:15:10 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c3c607-7b50-4224-8af3-a1cc95f865f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b3785ce-2af2-4a0a-b6fb-b9530a83420b', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:10 devstack sudo[90742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02 1073741824 Feb 27 02:15:10 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4507dab2-f47e-448d-989d-24a3fb06d49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:10 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Volume volume-4b3785ce-2af2-4a0a-b6fb-b9530a83420b (4b3785ce-2af2-4a0a-b6fb-b9530a83420b): created successfully Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4507dab2-f47e-448d-989d-24a3fb06d49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:10 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Flow 'volume_create_manager' (279589a8-15dd-450e-b9bc-ceda8665f895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:15:10 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-ff765f8e-ab2b-4ac6-b55d-b85fc4b5487d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Created volume successfully. Feb 27 02:15:11 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02 1073741824" returned: 0 in 0.476s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1eb8657-e835-4aca-ad26-77c70b953adb tempest-SnapshotDependencyTests-1839279197 None] Acquiring lock "cinder-3fbadee5-ccfc-4205-b17d-d1f1010378a0-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:11 devstack sudo[90747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02 Feb 27 02:15:11 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1eb8657-e835-4aca-ad26-77c70b953adb tempest-SnapshotDependencyTests-1839279197 None] Lock "cinder-3fbadee5-ccfc-4205-b17d-d1f1010378a0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1eb8657-e835-4aca-ad26-77c70b953adb tempest-SnapshotDependencyTests-1839279197 None] Acquiring lock "cinder-quobyte-3fbadee5-ccfc-4205-b17d-d1f1010378a0" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1eb8657-e835-4aca-ad26-77c70b953adb tempest-SnapshotDependencyTests-1839279197 None] Lock "cinder-quobyte-3fbadee5-ccfc-4205-b17d-d1f1010378a0" acquired by "delete_volume" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eea5b3d-434f-4203-9265-d9d9b4b64877]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a1eb8657-e835-4aca-ad26-77c70b953adb tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:11 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 Feb 27 02:15:11 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1f310423-c0dd-43a5-b7ae-e249f40832f3 tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "cinder-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1f310423-c0dd-43a5-b7ae-e249f40832f3 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1f310423-c0dd-43a5-b7ae-e249f40832f3 tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "cinder-quobyte-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1f310423-c0dd-43a5-b7ae-e249f40832f3 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-quobyte-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf" acquired by "delete_volume" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[002c37b0-7394-4aeb-8e0b-050a2d51ac1f]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1f310423-c0dd-43a5-b7ae-e249f40832f3 tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:11 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf Feb 27 02:15:11 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:11 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02" returned: 0 in 0.467s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.696s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2005001907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8531af0-2b12-4a4f-a97e-b02dbbc887aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4375a68889d449d38e95c4f1e0882515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:15:04Z,use_quota=True,user_id='fe099c2c6d684376993e0d9e37180656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Creating volume e8531af0-2b12-4a4f-a97e-b02dbbc887aa {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:15:11 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e8531af0-2b12-4a4f-a97e-b02dbbc887aa 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e4a9c3-4061-47ec-9eaa-0d90a178f3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:11 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e8531af0-2b12-4a4f-a97e-b02dbbc887aa 1073741824 Feb 27 02:15:11 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68d767b-73dd-4639-92dd-1f16170fca92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:11 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Volume volume-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02 (a89ed250-f4bf-4ae4-b5f9-d38aaff4da02): created successfully Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68d767b-73dd-4639-92dd-1f16170fca92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Flow 'volume_create_manager' (408937a9-af95-45dc-a1fb-32f057e558f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:15:11 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-5e3a94ca-b2de-44b4-9eea-b6097bc8094d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Created volume successfully. Feb 27 02:15:11 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a1eb8657-e835-4aca-ad26-77c70b953adb tempest-SnapshotDependencyTests-1839279197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0" returned: 0 in 0.534s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:11 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a1eb8657-e835-4aca-ad26-77c70b953adb tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:11 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0 Feb 27 02:15:11 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:12 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1f310423-c0dd-43a5-b7ae-e249f40832f3 tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf" returned: 0 in 0.509s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1f310423-c0dd-43a5-b7ae-e249f40832f3 tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:12 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf Feb 27 02:15:12 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:12 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e8531af0-2b12-4a4f-a97e-b02dbbc887aa 1073741824" returned: 0 in 0.533s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e8531af0-2b12-4a4f-a97e-b02dbbc887aa {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:12 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a1eb8657-e835-4aca-ad26-77c70b953adb tempest-SnapshotDependencyTests-1839279197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3fbadee5-ccfc-4205-b17d-d1f1010378a0" returned: 0 in 0.435s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:12 devstack sudo[90770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e8531af0-2b12-4a4f-a97e-b02dbbc887aa Feb 27 02:15:12 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1eb8657-e835-4aca-ad26-77c70b953adb tempest-SnapshotDependencyTests-1839279197 None] Lock "cinder-quobyte-3fbadee5-ccfc-4205-b17d-d1f1010378a0" released by "delete_volume" :: held 1.014s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-a1eb8657-e835-4aca-ad26-77c70b953adb tempest-SnapshotDependencyTests-1839279197 None] Created reservations ['f9fa72e3-711b-4062-88db-e71b461eabcc', '5893d461-ea23-4299-bf8c-ecc2d864b08f', '05bbaef3-85b4-4f23-a18c-b54784c7e481', 'fdbabd06-5d24-4922-8949-8807d8247a9a'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a1eb8657-e835-4aca-ad26-77c70b953adb tempest-SnapshotDependencyTests-1839279197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a1eb8657-e835-4aca-ad26-77c70b953adb tempest-SnapshotDependencyTests-1839279197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-a1eb8657-e835-4aca-ad26-77c70b953adb tempest-SnapshotDependencyTests-1839279197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-a1eb8657-e835-4aca-ad26-77c70b953adb tempest-SnapshotDependencyTests-1839279197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a1eb8657-e835-4aca-ad26-77c70b953adb tempest-SnapshotDependencyTests-1839279197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a1eb8657-e835-4aca-ad26-77c70b953adb tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:12 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:15:12 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:12 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1f310423-c0dd-43a5-b7ae-e249f40832f3 tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf" returned: 0 in 0.424s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1f310423-c0dd-43a5-b7ae-e249f40832f3 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-quobyte-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf" released by "delete_volume" :: held 0.965s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-1f310423-c0dd-43a5-b7ae-e249f40832f3 tempest-CreateVolumesFromSnapshotTest-283718236 None] Created reservations ['f7fa77fc-2a46-42e3-b354-726107d666c7', '8f4c855d-fb9f-464b-aea2-30c89c522acb', 'b013dee9-dd59-4b75-be90-f00769dd89f5', '5ce1776b-96ee-44b7-ad53-0b70329dacfd'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1f310423-c0dd-43a5-b7ae-e249f40832f3 tempest-CreateVolumesFromSnapshotTest-283718236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1f310423-c0dd-43a5-b7ae-e249f40832f3 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1f310423-c0dd-43a5-b7ae-e249f40832f3 tempest-CreateVolumesFromSnapshotTest-283718236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-1f310423-c0dd-43a5-b7ae-e249f40832f3 tempest-CreateVolumesFromSnapshotTest-283718236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-1f310423-c0dd-43a5-b7ae-e249f40832f3 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1f310423-c0dd-43a5-b7ae-e249f40832f3 tempest-CreateVolumesFromSnapshotTest-283718236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:12 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:15:12 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:12 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e8531af0-2b12-4a4f-a97e-b02dbbc887aa" returned: 0 in 0.409s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.406s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:12 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Cloning volume 3f8c5040-bdc3-46a4-9567-e5acdbb5f073 to volume 364d199e-f899-4aa6-ab01-f9e6f5b6e041 Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af545941-de58-4364-82af-8f283b5e5e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8531af0-2b12-4a4f-a97e-b02dbbc887aa', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e2a83f-dadf-4884-af6d-ac8dec3b764e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:12 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Volume volume-e8531af0-2b12-4a4f-a97e-b02dbbc887aa (e8531af0-2b12-4a4f-a97e-b02dbbc887aa): created successfully Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e2a83f-dadf-4884-af6d-ac8dec3b764e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Flow 'volume_create_manager' (1ed46082-b0e6-4f2f-8ea9-e0e54ed1548a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:15:12 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-8aa38389-e2aa-4ce6-8c8e-e8ca247f3f7a tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Created volume successfully. Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Creating offline snapshot 9e09695f-a7af-413d-a660-9d553a27084f of volume 3f8c5040-bdc3-46a4-9567-e5acdbb5f073 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e08a03e-a442-4915-90e3-6ed794555f16]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:12 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 Feb 27 02:15:12 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:12 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a1eb8657-e835-4aca-ad26-77c70b953adb tempest-SnapshotDependencyTests-1839279197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.491s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-a1eb8657-e835-4aca-ad26-77c70b953adb tempest-SnapshotDependencyTests-1839279197 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:15:12 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-a1eb8657-e835-4aca-ad26-77c70b953adb tempest-SnapshotDependencyTests-1839279197 None] Deleted volume successfully. Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1eb8657-e835-4aca-ad26-77c70b953adb tempest-SnapshotDependencyTests-1839279197 None] Lock "cinder-3fbadee5-ccfc-4205-b17d-d1f1010378a0-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:12 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-1f310423-c0dd-43a5-b7ae-e249f40832f3 tempest-CreateVolumesFromSnapshotTest-283718236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.417s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:12 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-1f310423-c0dd-43a5-b7ae-e249f40832f3 tempest-CreateVolumesFromSnapshotTest-283718236 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:15:12 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-1f310423-c0dd-43a5-b7ae-e249f40832f3 tempest-CreateVolumesFromSnapshotTest-283718236 None] Deleted volume successfully. Feb 27 02:15:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-1f310423-c0dd-43a5-b7ae-e249f40832f3 tempest-CreateVolumesFromSnapshotTest-283718236 None] Lock "cinder-d48bd3a5-a391-4c5d-9de2-f3e9a0fc6ddf-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:13 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073" returned: 0 in 0.497s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:13 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f 1G Feb 27 02:15:13 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-26c11fae-05b6-44a0-8718-57a8aab3e591 tempest-SnapshotDependencyTests-1839279197 None] Acquiring lock "cinder-482ac752-b81c-403e-8212-6726d22ebd07-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-26c11fae-05b6-44a0-8718-57a8aab3e591 tempest-SnapshotDependencyTests-1839279197 None] Lock "cinder-482ac752-b81c-403e-8212-6726d22ebd07-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-26c11fae-05b6-44a0-8718-57a8aab3e591 tempest-SnapshotDependencyTests-1839279197 None] Acquiring lock "cinder-quobyte-482ac752-b81c-403e-8212-6726d22ebd07" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-26c11fae-05b6-44a0-8718-57a8aab3e591 tempest-SnapshotDependencyTests-1839279197 None] Lock "cinder-quobyte-482ac752-b81c-403e-8212-6726d22ebd07" acquired by "delete_volume" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:13 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafd1a63-bf98-4723-bca9-dee4800f84c6]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-26c11fae-05b6-44a0-8718-57a8aab3e591 tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-482ac752-b81c-403e-8212-6726d22ebd07 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:13 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-482ac752-b81c-403e-8212-6726d22ebd07 Feb 27 02:15:13 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:13 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f 1G" returned: 0 in 0.538s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:13 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f Feb 27 02:15:13 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4dbdd672-e823-4a9a-86a3-501ea458df21 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "cinder-e8531af0-2b12-4a4f-a97e-b02dbbc887aa-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4dbdd672-e823-4a9a-86a3-501ea458df21 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-e8531af0-2b12-4a4f-a97e-b02dbbc887aa-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4dbdd672-e823-4a9a-86a3-501ea458df21 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "cinder-quobyte-e8531af0-2b12-4a4f-a97e-b02dbbc887aa" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:13 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4dbdd672-e823-4a9a-86a3-501ea458df21 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-quobyte-e8531af0-2b12-4a4f-a97e-b02dbbc887aa" acquired by "delete_volume" :: waited 0.016s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:13 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2cf618-d5d9-42f6-9da6-20b59a636be4]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:13 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4dbdd672-e823-4a9a-86a3-501ea458df21 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e8531af0-2b12-4a4f-a97e-b02dbbc887aa {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:13 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e8531af0-2b12-4a4f-a97e-b02dbbc887aa Feb 27 02:15:13 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:14 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-26c11fae-05b6-44a0-8718-57a8aab3e591 tempest-SnapshotDependencyTests-1839279197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-482ac752-b81c-403e-8212-6726d22ebd07" returned: 0 in 0.640s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-26c11fae-05b6-44a0-8718-57a8aab3e591 tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-482ac752-b81c-403e-8212-6726d22ebd07 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:14 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-482ac752-b81c-403e-8212-6726d22ebd07 Feb 27 02:15:14 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:14 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f" returned: 0 in 0.586s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:14 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f is being set with open permissions: ugo+rw Feb 27 02:15:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:14 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f Feb 27 02:15:14 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:14 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4dbdd672-e823-4a9a-86a3-501ea458df21 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e8531af0-2b12-4a4f-a97e-b02dbbc887aa" returned: 0 in 0.624s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4dbdd672-e823-4a9a-86a3-501ea458df21 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e8531af0-2b12-4a4f-a97e-b02dbbc887aa {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:14 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e8531af0-2b12-4a4f-a97e-b02dbbc887aa Feb 27 02:15:14 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:14 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-26c11fae-05b6-44a0-8718-57a8aab3e591 tempest-SnapshotDependencyTests-1839279197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-482ac752-b81c-403e-8212-6726d22ebd07" returned: 0 in 0.572s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:14 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-26c11fae-05b6-44a0-8718-57a8aab3e591 tempest-SnapshotDependencyTests-1839279197 None] Lock "cinder-quobyte-482ac752-b81c-403e-8212-6726d22ebd07" released by "delete_volume" :: held 1.233s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:14 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-26c11fae-05b6-44a0-8718-57a8aab3e591 tempest-SnapshotDependencyTests-1839279197 None] Created reservations ['49e3b4ac-3106-4f5e-9dad-0f3c58aecf46', 'b1ebf0d9-a537-4836-8aba-088be27bc341', '0497f553-794e-42e7-bcd7-a5369608578e', 'ed74e832-9bf8-450f-b7f3-b4bbaf2ef1b7'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-26c11fae-05b6-44a0-8718-57a8aab3e591 tempest-SnapshotDependencyTests-1839279197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-26c11fae-05b6-44a0-8718-57a8aab3e591 tempest-SnapshotDependencyTests-1839279197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:14 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-26c11fae-05b6-44a0-8718-57a8aab3e591 tempest-SnapshotDependencyTests-1839279197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:14 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-26c11fae-05b6-44a0-8718-57a8aab3e591 tempest-SnapshotDependencyTests-1839279197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-26c11fae-05b6-44a0-8718-57a8aab3e591 tempest-SnapshotDependencyTests-1839279197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-26c11fae-05b6-44a0-8718-57a8aab3e591 tempest-SnapshotDependencyTests-1839279197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:14 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:15:14 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:14 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f" returned: 0 in 0.539s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:14 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:14 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.info Feb 27 02:15:14 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:15 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4dbdd672-e823-4a9a-86a3-501ea458df21 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-e8531af0-2b12-4a4f-a97e-b02dbbc887aa" returned: 0 in 0.545s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4dbdd672-e823-4a9a-86a3-501ea458df21 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-quobyte-e8531af0-2b12-4a4f-a97e-b02dbbc887aa" released by "delete_volume" :: held 1.208s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-4dbdd672-e823-4a9a-86a3-501ea458df21 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Created reservations ['6bdd523e-fe1f-4884-9e92-103ed4861f79', '4f541f3b-7bbd-4af7-b9bf-ba7bb1d15ecf', 'bcdc4f67-6a4b-4348-9021-ca488c309145', '03883b53-f93e-4e01-b4ba-d920a7ad6577'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4dbdd672-e823-4a9a-86a3-501ea458df21 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4dbdd672-e823-4a9a-86a3-501ea458df21 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-4dbdd672-e823-4a9a-86a3-501ea458df21 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-4dbdd672-e823-4a9a-86a3-501ea458df21 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4dbdd672-e823-4a9a-86a3-501ea458df21 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4dbdd672-e823-4a9a-86a3-501ea458df21 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:15 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:15:15 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:15 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-26c11fae-05b6-44a0-8718-57a8aab3e591 tempest-SnapshotDependencyTests-1839279197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.583s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-26c11fae-05b6-44a0-8718-57a8aab3e591 tempest-SnapshotDependencyTests-1839279197 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:15:15 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-26c11fae-05b6-44a0-8718-57a8aab3e591 tempest-SnapshotDependencyTests-1839279197 None] Deleted volume successfully. Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-26c11fae-05b6-44a0-8718-57a8aab3e591 tempest-SnapshotDependencyTests-1839279197 None] Lock "cinder-482ac752-b81c-403e-8212-6726d22ebd07-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:15 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.info" returned: 0 in 0.555s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:15 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.info is being set with open permissions: ugo+rw Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:15 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.info Feb 27 02:15:15 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:15 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4dbdd672-e823-4a9a-86a3-501ea458df21 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.501s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-4dbdd672-e823-4a9a-86a3-501ea458df21 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:15:15 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-4dbdd672-e823-4a9a-86a3-501ea458df21 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Deleted volume successfully. Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4dbdd672-e823-4a9a-86a3-501ea458df21 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-e8531af0-2b12-4a4f-a97e-b02dbbc887aa-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Flow 'volume_create_manager' (da5634e7-0fb1-4a5d-9d1d-77954379d688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd7a118-fb87-4f1d-aa29-67e1a9cbe7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd7a118-fb87-4f1d-aa29-67e1a9cbe7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e4fb0a-75ac-4356-a6b8-56934a24cb13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da804df7bb914a9b8673bf97c97e9784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:15:16Z,use_quota=True,user_id='eeafdb3f81644f20b22b49721130d5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e67cb78-76e2-4863-8a36-7e15881837e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e67cb78-76e2-4863-8a36-7e15881837e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d336b3-5b85-442f-a342-4dc482219dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d336b3-5b85-442f-a342-4dc482219dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e4fb0a-75ac-4356-a6b8-56934a24cb13', 'volume_name': 'volume-97e4fb0a-75ac-4356-a6b8-56934a24cb13', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591ffe56-4c01-4c3f-bd35-65bd0b67e3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591ffe56-4c01-4c3f-bd35-65bd0b67e3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297a2c5e-cc52-4c63-89b0-b58bec5ac7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:15 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Volume 97e4fb0a-75ac-4356-a6b8-56934a24cb13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e4fb0a-75ac-4356-a6b8-56934a24cb13', 'volume_size': 1} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:15 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.info" returned: 0 in 0.458s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "cinder-quobyte-364d199e-f899-4aa6-ab01-f9e6f5b6e041" by "_copy_volume_from_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-quobyte-364d199e-f899-4aa6-ab01-f9e6f5b6e041" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] snapshot: 9e09695f-a7af-413d-a660-9d553a27084f, volume: 364d199e-f899-4aa6-ab01-f9e6f5b6e041, {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:15 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:16 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb5effb-33cd-4123-bb80-b0d960f40bee]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:16 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d2cc2f99-160c-4175-b85f-755ef57bd750 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "cinder-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:16 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d2cc2f99-160c-4175-b85f-755ef57bd750 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:16 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d2cc2f99-160c-4175-b85f-755ef57bd750 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "cinder-quobyte-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:16 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d2cc2f99-160c-4175-b85f-755ef57bd750 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-quobyte-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02" acquired by "delete_volume" :: waited 0.008s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:16 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f Feb 27 02:15:16 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:16 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[2072d8d2-208f-42da-b072-6166e3bb4437]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d2cc2f99-160c-4175-b85f-755ef57bd750 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:16 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02 Feb 27 02:15:16 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:16 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f" returned: 0 in 0.566s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:15:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:15:16 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Creating direct copy from snapshot {{(pid=82738) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:15:16 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8957a9-8c57-471b-8e82-c3f823dcd578]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:16 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d2cc2f99-160c-4175-b85f-755ef57bd750 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02" returned: 0 in 0.528s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:16 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d2cc2f99-160c-4175-b85f-755ef57bd750 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:16 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 Feb 27 02:15:16 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:16 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02 Feb 27 02:15:16 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:17 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073" returned: 0 in 0.514s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:17 devstack cinder-volume[82738]: DEBUG cinder.utils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Path /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-364d199e-f899-4aa6-ab01-f9e6f5b6e041 not found in is_blk_device check {{(pid=82738) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:15:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-364d199e-f899-4aa6-ab01-f9e6f5b6e041 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:17 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d2cc2f99-160c-4175-b85f-755ef57bd750 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02" returned: 0 in 0.456s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:17 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d2cc2f99-160c-4175-b85f-755ef57bd750 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-quobyte-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02" released by "delete_volume" :: held 1.017s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:17 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-364d199e-f899-4aa6-ab01-f9e6f5b6e041 Feb 27 02:15:17 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:17 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-d2cc2f99-160c-4175-b85f-755ef57bd750 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Created reservations ['29ffd1c8-3510-4748-93c8-09f34c41dbd3', '9c3f7d37-b52c-4a7a-a939-c559beff5782', 'afd8e683-0949-49ba-867c-8e9ee2c088d8', '9c7fc0da-847d-4ada-9a06-3303414a53b0'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d2cc2f99-160c-4175-b85f-755ef57bd750 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d2cc2f99-160c-4175-b85f-755ef57bd750 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:17 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d2cc2f99-160c-4175-b85f-755ef57bd750 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:17 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d2cc2f99-160c-4175-b85f-755ef57bd750 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d2cc2f99-160c-4175-b85f-755ef57bd750 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:17 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d2cc2f99-160c-4175-b85f-755ef57bd750 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:17 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:15:17 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:18 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d2cc2f99-160c-4175-b85f-755ef57bd750 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.924s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:18 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-d2cc2f99-160c-4175-b85f-755ef57bd750 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:15:18 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-d2cc2f99-160c-4175-b85f-755ef57bd750 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Deleted volume successfully. Feb 27 02:15:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d2cc2f99-160c-4175-b85f-755ef57bd750 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-a89ed250-f4bf-4ae4-b5f9-d38aaff4da02-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-520265fe-0f21-42b7-b690-aeaa2a8416f7 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "cinder-4b3785ce-2af2-4a0a-b6fb-b9530a83420b-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-520265fe-0f21-42b7-b690-aeaa2a8416f7 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-4b3785ce-2af2-4a0a-b6fb-b9530a83420b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-520265fe-0f21-42b7-b690-aeaa2a8416f7 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "cinder-quobyte-4b3785ce-2af2-4a0a-b6fb-b9530a83420b" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:18 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-520265fe-0f21-42b7-b690-aeaa2a8416f7 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-quobyte-4b3785ce-2af2-4a0a-b6fb-b9530a83420b" acquired by "delete_volume" :: waited 0.042s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:18 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15cebf6-5d57-40b2-83e7-f7d348fc82c7]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:18 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-520265fe-0f21-42b7-b690-aeaa2a8416f7 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4b3785ce-2af2-4a0a-b6fb-b9530a83420b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:19 devstack sudo[90867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4b3785ce-2af2-4a0a-b6fb-b9530a83420b Feb 27 02:15:19 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:19 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-364d199e-f899-4aa6-ab01-f9e6f5b6e041" returned: 0 in 2.302s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:19 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc95b12-dbf8-430d-8a15-b54e60f143f1]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:19 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 Feb 27 02:15:19 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:19 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-520265fe-0f21-42b7-b690-aeaa2a8416f7 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4b3785ce-2af2-4a0a-b6fb-b9530a83420b" returned: 0 in 1.104s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:19 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-520265fe-0f21-42b7-b690-aeaa2a8416f7 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4b3785ce-2af2-4a0a-b6fb-b9530a83420b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:19 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4b3785ce-2af2-4a0a-b6fb-b9530a83420b Feb 27 02:15:19 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:20 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073" returned: 0 in 0.670s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG cinder.image.image_utils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073, size 1024.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-364d199e-f899-4aa6-ab01-f9e6f5b6e041 {{(pid=82738) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:15:20 devstack cinder-volume[82738]: INFO cinder.image.image_utils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Converted 1024.00 MB image at 444.56 MB/s Feb 27 02:15:20 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-364d199e-f899-4aa6-ab01-f9e6f5b6e041 is being set with open permissions: ugo+rw Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-364d199e-f899-4aa6-ab01-f9e6f5b6e041 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:20 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-364d199e-f899-4aa6-ab01-f9e6f5b6e041 Feb 27 02:15:20 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:20 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-520265fe-0f21-42b7-b690-aeaa2a8416f7 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4b3785ce-2af2-4a0a-b6fb-b9530a83420b" returned: 0 in 0.439s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-520265fe-0f21-42b7-b690-aeaa2a8416f7 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-quobyte-4b3785ce-2af2-4a0a-b6fb-b9530a83420b" released by "delete_volume" :: held 1.600s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-520265fe-0f21-42b7-b690-aeaa2a8416f7 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Created reservations ['74fbea9c-ea1e-45f3-8812-6a9b86917c7b', 'd5464641-235d-453a-b2dc-9013af97021c', '108a1777-15dd-4d32-855c-03dfb7209c9d', 'f51fc6cb-b101-4c7b-85a0-ee869ae9f53e'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-520265fe-0f21-42b7-b690-aeaa2a8416f7 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-520265fe-0f21-42b7-b690-aeaa2a8416f7 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-520265fe-0f21-42b7-b690-aeaa2a8416f7 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-520265fe-0f21-42b7-b690-aeaa2a8416f7 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-520265fe-0f21-42b7-b690-aeaa2a8416f7 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-520265fe-0f21-42b7-b690-aeaa2a8416f7 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:20 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:15:20 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:20 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-364d199e-f899-4aa6-ab01-f9e6f5b6e041" returned: 0 in 0.514s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-quobyte-364d199e-f899-4aa6-ab01-f9e6f5b6e041" released by "_copy_volume_from_snapshot" :: held 4.626s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "cinder-quobyte-9e09695f-a7af-413d-a660-9d553a27084f" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-quobyte-9e09695f-a7af-413d-a660-9d553a27084f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Deleting offline snapshot 9e09695f-a7af-413d-a660-9d553a27084f of volume 3f8c5040-bdc3-46a4-9567-e5acdbb5f073 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] snapshot_file for this snap is: volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af8a2cb-ee4c-476b-818e-eba7fd5a2e35]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-59b41419-bf3f-431c-9afe-ad230be2b114 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "cinder-18054895-2e42-42b8-bbec-f98413221efc-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-59b41419-bf3f-431c-9afe-ad230be2b114 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-18054895-2e42-42b8-bbec-f98413221efc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-59b41419-bf3f-431c-9afe-ad230be2b114 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "cinder-quobyte-18054895-2e42-42b8-bbec-f98413221efc" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:20 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-520265fe-0f21-42b7-b690-aeaa2a8416f7 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.521s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-520265fe-0f21-42b7-b690-aeaa2a8416f7 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-59b41419-bf3f-431c-9afe-ad230be2b114 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-quobyte-18054895-2e42-42b8-bbec-f98413221efc" acquired by "delete_volume" :: waited 0.023s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:20 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-520265fe-0f21-42b7-b690-aeaa2a8416f7 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Deleted volume successfully. Feb 27 02:15:20 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f Feb 27 02:15:20 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f7a16d-ba5f-4120-919b-6a90139e1340]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-59b41419-bf3f-431c-9afe-ad230be2b114 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-18054895-2e42-42b8-bbec-f98413221efc {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:20 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-520265fe-0f21-42b7-b690-aeaa2a8416f7 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-4b3785ce-2af2-4a0a-b6fb-b9530a83420b-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:20 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-18054895-2e42-42b8-bbec-f98413221efc Feb 27 02:15:20 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:21 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f" returned: 0 in 0.663s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:21 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:15:21 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaadaa2-8a9c-41ba-a8a6-2b6f0c3b4cb5]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:21 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-59b41419-bf3f-431c-9afe-ad230be2b114 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-18054895-2e42-42b8-bbec-f98413221efc" returned: 0 in 0.578s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-59b41419-bf3f-431c-9afe-ad230be2b114 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-18054895-2e42-42b8-bbec-f98413221efc {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:21 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 Feb 27 02:15:21 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:21 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-18054895-2e42-42b8-bbec-f98413221efc Feb 27 02:15:21 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:21 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-59b41419-bf3f-431c-9afe-ad230be2b114 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-18054895-2e42-42b8-bbec-f98413221efc" returned: 0 in 0.475s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:21 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-59b41419-bf3f-431c-9afe-ad230be2b114 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-quobyte-18054895-2e42-42b8-bbec-f98413221efc" released by "delete_volume" :: held 1.090s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:21 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073" returned: 0 in 0.558s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:21 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f Feb 27 02:15:21 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:21 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-59b41419-bf3f-431c-9afe-ad230be2b114 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Created reservations ['902fce94-1440-455c-9c22-02b98f900c77', '91fd9911-f63f-4663-b1eb-ba27c8d91559', '835057de-15af-4571-aa7b-5944a2e9be3a', 'f846f500-d4c8-4d25-a102-98a31bade2d6'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-59b41419-bf3f-431c-9afe-ad230be2b114 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-59b41419-bf3f-431c-9afe-ad230be2b114 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:21 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-59b41419-bf3f-431c-9afe-ad230be2b114 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:21 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-59b41419-bf3f-431c-9afe-ad230be2b114 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-59b41419-bf3f-431c-9afe-ad230be2b114 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:21 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-59b41419-bf3f-431c-9afe-ad230be2b114 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:22 devstack sudo[90944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:15:22 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:22 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f" returned: 0 in 0.518s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:22 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f Feb 27 02:15:22 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:22 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-59b41419-bf3f-431c-9afe-ad230be2b114 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.486s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:22 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-59b41419-bf3f-431c-9afe-ad230be2b114 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:15:22 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-59b41419-bf3f-431c-9afe-ad230be2b114 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Deleted volume successfully. Feb 27 02:15:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-59b41419-bf3f-431c-9afe-ad230be2b114 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-18054895-2e42-42b8-bbec-f98413221efc-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8eb4cee6-c3df-4112-be76-63afe4046e8d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "cinder-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8eb4cee6-c3df-4112-be76-63afe4046e8d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8eb4cee6-c3df-4112-be76-63afe4046e8d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "cinder-quobyte-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:22 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8eb4cee6-c3df-4112-be76-63afe4046e8d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-quobyte-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b" acquired by "delete_volume" :: waited 0.007s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:22 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec61d6b-c362-4fb0-8c2d-024a5bf0c63f]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8eb4cee6-c3df-4112-be76-63afe4046e8d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:22 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:22 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073.9e09695f-a7af-413d-a660-9d553a27084f" returned: 0 in 0.573s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:23 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b Feb 27 02:15:23 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-quobyte-9e09695f-a7af-413d-a660-9d553a27084f" released by "_delete_snapshot" :: held 2.380s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.376s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.180s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e4fb0a-75ac-4356-a6b8-56934a24cb13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da804df7bb914a9b8673bf97c97e9784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:15:16Z,use_quota=True,user_id='eeafdb3f81644f20b22b49721130d5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Creating volume 97e4fb0a-75ac-4356-a6b8-56934a24cb13 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:15:23 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-97e4fb0a-75ac-4356-a6b8-56934a24cb13 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (221e2ef7-cd08-4dd1-8ff3-363d71650e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-364d199e-f899-4aa6-ab01-f9e6f5b6e041', 'volume_size': 1, 'source_volid': '3f8c5040-bdc3-46a4-9567-e5acdbb5f073', 'source_volstatus': 'available'}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:23 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-97e4fb0a-75ac-4356-a6b8-56934a24cb13 1073741824 Feb 27 02:15:23 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6307348c-19d7-4dbf-bd8d-15a9a87c8473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:23 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Volume volume-364d199e-f899-4aa6-ab01-f9e6f5b6e041 (364d199e-f899-4aa6-ab01-f9e6f5b6e041): created successfully Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6307348c-19d7-4dbf-bd8d-15a9a87c8473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Flow 'volume_create_manager' (f08978c2-aed8-424e-8203-80cf8b8ea3cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:15:23 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-d9a13565-e676-40f3-90ab-b408ec5fa8a7 tempest-VolumeDependencyTests-1320295309 None] Created volume successfully. Feb 27 02:15:23 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8eb4cee6-c3df-4112-be76-63afe4046e8d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b" returned: 0 in 0.627s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8eb4cee6-c3df-4112-be76-63afe4046e8d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:23 devstack sudo[90964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b Feb 27 02:15:23 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:23 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-97e4fb0a-75ac-4356-a6b8-56934a24cb13 1073741824" returned: 0 in 0.581s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c157febb-2fa4-43e0-9f69-1ba82a378871 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "cinder-3f8c5040-bdc3-46a4-9567-e5acdbb5f073-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG oslo_service.periodic_task [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82738) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-97e4fb0a-75ac-4356-a6b8-56934a24cb13 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:23 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:15:23 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c157febb-2fa4-43e0-9f69-1ba82a378871 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-3f8c5040-bdc3-46a4-9567-e5acdbb5f073-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:23 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-97e4fb0a-75ac-4356-a6b8-56934a24cb13 Feb 27 02:15:23 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c157febb-2fa4-43e0-9f69-1ba82a378871 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "cinder-quobyte-3f8c5040-bdc3-46a4-9567-e5acdbb5f073" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c157febb-2fa4-43e0-9f69-1ba82a378871 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-quobyte-3f8c5040-bdc3-46a4-9567-e5acdbb5f073" acquired by "delete_volume" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c07798-419f-4cbb-999d-6252ae383751]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:23 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c157febb-2fa4-43e0-9f69-1ba82a378871 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:23 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 Feb 27 02:15:23 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:23 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8eb4cee6-c3df-4112-be76-63afe4046e8d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b" returned: 0 in 0.442s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8eb4cee6-c3df-4112-be76-63afe4046e8d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-quobyte-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b" released by "delete_volume" :: held 1.099s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-8eb4cee6-c3df-4112-be76-63afe4046e8d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Created reservations ['198550a9-ec44-4dfd-9844-7c04fc94e7a1', 'bc51d3ca-299e-44a1-8a6b-f8f0742a4da3', 'cc0fa8d3-7b84-4caa-849f-b1ff6f1d1549', '8c643360-8097-4166-b78a-f1e8c0536133'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8eb4cee6-c3df-4112-be76-63afe4046e8d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8eb4cee6-c3df-4112-be76-63afe4046e8d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8eb4cee6-c3df-4112-be76-63afe4046e8d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8eb4cee6-c3df-4112-be76-63afe4046e8d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8eb4cee6-c3df-4112-be76-63afe4046e8d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8eb4cee6-c3df-4112-be76-63afe4046e8d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:24 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:15:24 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:24 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.464s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-3555e2d5-32f9-4090-b4e2-c94d94a3a67b None None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:15:24 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-97e4fb0a-75ac-4356-a6b8-56934a24cb13" returned: 0 in 0.509s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297a2c5e-cc52-4c63-89b0-b58bec5ac7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e4fb0a-75ac-4356-a6b8-56934a24cb13', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76482659-d530-4857-87fe-39bbcdfb4236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:24 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Volume volume-97e4fb0a-75ac-4356-a6b8-56934a24cb13 (97e4fb0a-75ac-4356-a6b8-56934a24cb13): created successfully Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76482659-d530-4857-87fe-39bbcdfb4236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Flow 'volume_create_manager' (da5634e7-0fb1-4a5d-9d1d-77954379d688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:15:24 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-d9a42a02-9fa5-4269-b0e2-ace8f613f329 tempest-CinderUnicodeTest-1881682297 None] Created volume successfully. Feb 27 02:15:24 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c157febb-2fa4-43e0-9f69-1ba82a378871 tempest-VolumeDependencyTests-1320295309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073" returned: 0 in 0.575s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c157febb-2fa4-43e0-9f69-1ba82a378871 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:24 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073 Feb 27 02:15:24 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:24 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8eb4cee6-c3df-4112-be76-63afe4046e8d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.442s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-8eb4cee6-c3df-4112-be76-63afe4046e8d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:15:24 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-8eb4cee6-c3df-4112-be76-63afe4046e8d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Deleted volume successfully. Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8eb4cee6-c3df-4112-be76-63afe4046e8d tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-4ceec4de-0fd0-44aa-b6d2-b3fd8de9711b-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.flows.manager.create_volume [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82738) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Flow 'volume_create_manager' (81145d0f-ca69-4d77-8ad9-90f4e6c7f0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce10cf2f-a993-45c8-8eca-13571bcd302d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce10cf2f-a993-45c8-8eca-13571bcd302d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:15:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1212909218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=578acbf6-28c8-45cc-bbfa-4c72f52ac437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da804df7bb914a9b8673bf97c97e9784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:15:25Z,use_quota=True,user_id='eeafdb3f81644f20b22b49721130d5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4803eaf7-9181-465d-b1ea-61e84042f5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4803eaf7-9181-465d-b1ea-61e84042f5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e694b9-6d01-4ffd-b3af-d85f1d5b46db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e694b9-6d01-4ffd-b3af-d85f1d5b46db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '578acbf6-28c8-45cc-bbfa-4c72f52ac437', 'volume_name': 'volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98bdcd11-0fdf-4231-a641-953090518a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98bdcd11-0fdf-4231-a641-953090518a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59811686-f55a-468a-8e93-72cf7fa6fe60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:24 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Volume 578acbf6-28c8-45cc-bbfa-4c72f52ac437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437', 'volume_size': 1} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:15:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1212909218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=578acbf6-28c8-45cc-bbfa-4c72f52ac437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da804df7bb914a9b8673bf97c97e9784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:15:25Z,use_quota=True,user_id='eeafdb3f81644f20b22b49721130d5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dccf02b-f099-4833-98e5-33124aa68fe1),volume_type_id=9dccf02b-f099-4833-98e5-33124aa68fe1)}" {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Creating volume 578acbf6-28c8-45cc-bbfa-4c72f52ac437 {{(pid=82738) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Selected osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf as target Quobyte volume. {{(pid=82738) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:15:24 devstack cinder-volume[82738]: INFO cinder.volume.drivers.remotefs [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] casted to osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437 1073741824 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:24 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437 1073741824 Feb 27 02:15:24 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:24 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c157febb-2fa4-43e0-9f69-1ba82a378871 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-3f8c5040-bdc3-46a4-9567-e5acdbb5f073" returned: 0 in 0.499s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c157febb-2fa4-43e0-9f69-1ba82a378871 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-quobyte-3f8c5040-bdc3-46a4-9567-e5acdbb5f073" released by "delete_volume" :: held 1.119s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-c157febb-2fa4-43e0-9f69-1ba82a378871 tempest-VolumeDependencyTests-1320295309 None] Created reservations ['4b6c363f-af73-4b5a-ab29-2ee5b215b758', 'aec99654-d14e-4953-9f09-a16c0a0ffbc2', '83faa31d-20c1-46db-b80c-28058b1c36b2', '0ade0d59-e788-469e-9300-26e6a72b1776'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c157febb-2fa4-43e0-9f69-1ba82a378871 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c157febb-2fa4-43e0-9f69-1ba82a378871 tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-c157febb-2fa4-43e0-9f69-1ba82a378871 tempest-VolumeDependencyTests-1320295309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-c157febb-2fa4-43e0-9f69-1ba82a378871 tempest-VolumeDependencyTests-1320295309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-c157febb-2fa4-43e0-9f69-1ba82a378871 tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:24 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c157febb-2fa4-43e0-9f69-1ba82a378871 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:24 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:15:24 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9f5591f3-63bd-42e6-ab3d-254fe815aa22 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "cinder-a345b7a3-c182-47b4-a8f7-fed2433a9f11-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9f5591f3-63bd-42e6-ab3d-254fe815aa22 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-a345b7a3-c182-47b4-a8f7-fed2433a9f11-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9f5591f3-63bd-42e6-ab3d-254fe815aa22 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "cinder-quobyte-a345b7a3-c182-47b4-a8f7-fed2433a9f11" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9f5591f3-63bd-42e6-ab3d-254fe815aa22 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-quobyte-a345b7a3-c182-47b4-a8f7-fed2433a9f11" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[234bb48c-9f95-4e39-95a0-50790052d6ca]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9f5591f3-63bd-42e6-ab3d-254fe815aa22 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a345b7a3-c182-47b4-a8f7-fed2433a9f11 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:25 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a345b7a3-c182-47b4-a8f7-fed2433a9f11 Feb 27 02:15:25 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:25 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437 1073741824" returned: 0 in 0.545s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:25 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-c157febb-2fa4-43e0-9f69-1ba82a378871 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.447s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-c157febb-2fa4-43e0-9f69-1ba82a378871 tempest-VolumeDependencyTests-1320295309 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:15:25 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-c157febb-2fa4-43e0-9f69-1ba82a378871 tempest-VolumeDependencyTests-1320295309 None] Deleted volume successfully. Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:25 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437 Feb 27 02:15:25 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-c157febb-2fa4-43e0-9f69-1ba82a378871 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-3f8c5040-bdc3-46a4-9567-e5acdbb5f073-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:25 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9f5591f3-63bd-42e6-ab3d-254fe815aa22 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a345b7a3-c182-47b4-a8f7-fed2433a9f11" returned: 0 in 0.532s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9f5591f3-63bd-42e6-ab3d-254fe815aa22 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a345b7a3-c182-47b4-a8f7-fed2433a9f11 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:25 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a345b7a3-c182-47b4-a8f7-fed2433a9f11 Feb 27 02:15:25 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8648532d-4d9d-48b3-85a5-b8d39a293d14 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "cinder-364d199e-f899-4aa6-ab01-f9e6f5b6e041-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8648532d-4d9d-48b3-85a5-b8d39a293d14 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-364d199e-f899-4aa6-ab01-f9e6f5b6e041-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:25 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8648532d-4d9d-48b3-85a5-b8d39a293d14 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "cinder-quobyte-364d199e-f899-4aa6-ab01-f9e6f5b6e041" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437" returned: 0 in 0.444s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'} {{(pid=82738) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8648532d-4d9d-48b3-85a5-b8d39a293d14 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-quobyte-364d199e-f899-4aa6-ab01-f9e6f5b6e041" acquired by "delete_volume" :: waited 0.012s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59811686-f55a-468a-8e93-72cf7fa6fe60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437', 'volume_size': 1}' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec19ece-9ee9-45e6-a45d-2fc971c436f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9556731-154d-47bc-bf42-915d7e2777b8]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8648532d-4d9d-48b3-85a5-b8d39a293d14 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-364d199e-f899-4aa6-ab01-f9e6f5b6e041 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:25 devstack cinder-volume[82738]: INFO cinder.volume.flows.manager.create_volume [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Volume volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437 (578acbf6-28c8-45cc-bbfa-4c72f52ac437): created successfully Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec19ece-9ee9-45e6-a45d-2fc971c436f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82738) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:15:25 devstack cinder-volume[82738]: DEBUG cinder.volume.manager [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Flow 'volume_create_manager' (81145d0f-ca69-4d77-8ad9-90f4e6c7f0bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82738) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:15:25 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-51ca0b44-7ef0-467d-82f6-632586144a8c tempest-CinderUnicodeTest-1881682297 None] Created volume successfully. Feb 27 02:15:25 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-364d199e-f899-4aa6-ab01-f9e6f5b6e041 Feb 27 02:15:25 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:26 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9f5591f3-63bd-42e6-ab3d-254fe815aa22 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-a345b7a3-c182-47b4-a8f7-fed2433a9f11" returned: 0 in 0.453s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9f5591f3-63bd-42e6-ab3d-254fe815aa22 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-quobyte-a345b7a3-c182-47b4-a8f7-fed2433a9f11" released by "delete_volume" :: held 1.007s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-9f5591f3-63bd-42e6-ab3d-254fe815aa22 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Created reservations ['540a85ec-f614-46d2-9928-20d7060fd955', '2e921c6d-0860-419f-aae7-412f38d292e5', 'e13193c0-c2b4-4197-850e-915373485f1f', 'd4e78300-0669-4dd8-b8c5-95bd98a29633'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9f5591f3-63bd-42e6-ab3d-254fe815aa22 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9f5591f3-63bd-42e6-ab3d-254fe815aa22 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9f5591f3-63bd-42e6-ab3d-254fe815aa22 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-9f5591f3-63bd-42e6-ab3d-254fe815aa22 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-9f5591f3-63bd-42e6-ab3d-254fe815aa22 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9f5591f3-63bd-42e6-ab3d-254fe815aa22 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:26 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:15:26 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:26 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8648532d-4d9d-48b3-85a5-b8d39a293d14 tempest-VolumeDependencyTests-1320295309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-364d199e-f899-4aa6-ab01-f9e6f5b6e041" returned: 0 in 0.499s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8648532d-4d9d-48b3-85a5-b8d39a293d14 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-364d199e-f899-4aa6-ab01-f9e6f5b6e041 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:26 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-364d199e-f899-4aa6-ab01-f9e6f5b6e041 Feb 27 02:15:26 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:26 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-9f5591f3-63bd-42e6-ab3d-254fe815aa22 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.408s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-9f5591f3-63bd-42e6-ab3d-254fe815aa22 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:15:26 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-9f5591f3-63bd-42e6-ab3d-254fe815aa22 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Deleted volume successfully. Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-9f5591f3-63bd-42e6-ab3d-254fe815aa22 tempest-CreateVolumesFromSourceVolumeTest-1064228534 None] Lock "cinder-a345b7a3-c182-47b4-a8f7-fed2433a9f11-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:26 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8648532d-4d9d-48b3-85a5-b8d39a293d14 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-364d199e-f899-4aa6-ab01-f9e6f5b6e041" returned: 0 in 0.413s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8648532d-4d9d-48b3-85a5-b8d39a293d14 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-quobyte-364d199e-f899-4aa6-ab01-f9e6f5b6e041" released by "delete_volume" :: held 0.956s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-8648532d-4d9d-48b3-85a5-b8d39a293d14 tempest-VolumeDependencyTests-1320295309 None] Created reservations ['2aaf45d4-8792-442f-aab4-93de632ec8b1', '6aa551ff-cbf4-4a66-859d-c4d2f35c1340', '570c7515-3bb3-44f5-8525-93cc721a0e10', 'd0f54b69-d364-4903-9378-d784c2b6572c'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8648532d-4d9d-48b3-85a5-b8d39a293d14 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8648532d-4d9d-48b3-85a5-b8d39a293d14 tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8648532d-4d9d-48b3-85a5-b8d39a293d14 tempest-VolumeDependencyTests-1320295309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-8648532d-4d9d-48b3-85a5-b8d39a293d14 tempest-VolumeDependencyTests-1320295309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-8648532d-4d9d-48b3-85a5-b8d39a293d14 tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:26 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8648532d-4d9d-48b3-85a5-b8d39a293d14 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:26 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:15:26 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:27 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a70d7315-afcd-4eae-a093-e887eade20e3 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "cinder-6b52880e-5e9d-47ff-a208-ba443ecb9787-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:27 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a70d7315-afcd-4eae-a093-e887eade20e3 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-6b52880e-5e9d-47ff-a208-ba443ecb9787-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-90298f64-e306-4097-9d79-72bc7b3e3867 tempest-CinderUnicodeTest-1881682297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-90298f64-e306-4097-9d79-72bc7b3e3867 tempest-CinderUnicodeTest-1881682297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:27 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a70d7315-afcd-4eae-a093-e887eade20e3 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "cinder-quobyte-6b52880e-5e9d-47ff-a208-ba443ecb9787" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:27 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-90298f64-e306-4097-9d79-72bc7b3e3867 tempest-CinderUnicodeTest-1881682297 None] Creating offline snapshot 6266ce9c-5848-4ae6-853e-92aba9cf01a5 of volume 578acbf6-28c8-45cc-bbfa-4c72f52ac437 {{(pid=82738) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:15:27 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a70d7315-afcd-4eae-a093-e887eade20e3 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-quobyte-6b52880e-5e9d-47ff-a208-ba443ecb9787" acquired by "delete_volume" :: waited 0.017s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:27 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[8514b553-b429-4962-9486-abf546045573]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90298f64-e306-4097-9d79-72bc7b3e3867 tempest-CinderUnicodeTest-1881682297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:27 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8442c60-62ef-49e5-8b43-e5a65dd03c8d]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a70d7315-afcd-4eae-a093-e887eade20e3 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6b52880e-5e9d-47ff-a208-ba443ecb9787 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:27 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437 Feb 27 02:15:27 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:27 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6b52880e-5e9d-47ff-a208-ba443ecb9787 Feb 27 02:15:27 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:27 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-8648532d-4d9d-48b3-85a5-b8d39a293d14 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.523s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:27 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-8648532d-4d9d-48b3-85a5-b8d39a293d14 tempest-VolumeDependencyTests-1320295309 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:15:27 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-8648532d-4d9d-48b3-85a5-b8d39a293d14 tempest-VolumeDependencyTests-1320295309 None] Deleted volume successfully. Feb 27 02:15:27 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-8648532d-4d9d-48b3-85a5-b8d39a293d14 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-364d199e-f899-4aa6-ab01-f9e6f5b6e041-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:27 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a70d7315-afcd-4eae-a093-e887eade20e3 tempest-VolumeDependencyTests-1320295309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6b52880e-5e9d-47ff-a208-ba443ecb9787" returned: 0 in 0.540s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a70d7315-afcd-4eae-a093-e887eade20e3 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6b52880e-5e9d-47ff-a208-ba443ecb9787 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:27 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90298f64-e306-4097-9d79-72bc7b3e3867 tempest-CinderUnicodeTest-1881682297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437" returned: 0 in 0.564s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:27 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90298f64-e306-4097-9d79-72bc7b3e3867 tempest-CinderUnicodeTest-1881682297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.6266ce9c-5848-4ae6-853e-92aba9cf01a5 1G {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:27 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6b52880e-5e9d-47ff-a208-ba443ecb9787 Feb 27 02:15:27 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:27 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.6266ce9c-5848-4ae6-853e-92aba9cf01a5 1G Feb 27 02:15:27 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:28 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a70d7315-afcd-4eae-a093-e887eade20e3 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-6b52880e-5e9d-47ff-a208-ba443ecb9787" returned: 0 in 0.517s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:28 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a70d7315-afcd-4eae-a093-e887eade20e3 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-quobyte-6b52880e-5e9d-47ff-a208-ba443ecb9787" released by "delete_volume" :: held 1.089s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:28 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-a70d7315-afcd-4eae-a093-e887eade20e3 tempest-VolumeDependencyTests-1320295309 None] Created reservations ['514ea4c5-1ac7-4724-82a2-3c06c1abed8c', 'a79a0fbb-243c-4386-95e5-2bd8c56277ab', '378fc1d2-99b5-4ad1-acf5-d5ee1f3360ff', 'aa9e6ff7-92a3-4b9e-892f-53317e889501'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a70d7315-afcd-4eae-a093-e887eade20e3 tempest-VolumeDependencyTests-1320295309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a70d7315-afcd-4eae-a093-e887eade20e3 tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:28 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-a70d7315-afcd-4eae-a093-e887eade20e3 tempest-VolumeDependencyTests-1320295309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:28 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-a70d7315-afcd-4eae-a093-e887eade20e3 tempest-VolumeDependencyTests-1320295309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-a70d7315-afcd-4eae-a093-e887eade20e3 tempest-VolumeDependencyTests-1320295309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a70d7315-afcd-4eae-a093-e887eade20e3 tempest-VolumeDependencyTests-1320295309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:28 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:15:28 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:28 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90298f64-e306-4097-9d79-72bc7b3e3867 tempest-CinderUnicodeTest-1881682297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.6266ce9c-5848-4ae6-853e-92aba9cf01a5 1G" returned: 0 in 0.617s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90298f64-e306-4097-9d79-72bc7b3e3867 tempest-CinderUnicodeTest-1881682297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.6266ce9c-5848-4ae6-853e-92aba9cf01a5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:28 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.6266ce9c-5848-4ae6-853e-92aba9cf01a5 Feb 27 02:15:28 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:28 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:28 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a70d7315-afcd-4eae-a093-e887eade20e3 tempest-VolumeDependencyTests-1320295309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.436s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:28 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-a70d7315-afcd-4eae-a093-e887eade20e3 tempest-VolumeDependencyTests-1320295309 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:15:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90298f64-e306-4097-9d79-72bc7b3e3867 tempest-CinderUnicodeTest-1881682297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437 -F qcow2 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.6266ce9c-5848-4ae6-853e-92aba9cf01a5" returned: 0 in 0.411s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:28 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-90298f64-e306-4097-9d79-72bc7b3e3867 tempest-CinderUnicodeTest-1881682297 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.6266ce9c-5848-4ae6-853e-92aba9cf01a5 is being set with open permissions: ugo+rw Feb 27 02:15:28 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90298f64-e306-4097-9d79-72bc7b3e3867 tempest-CinderUnicodeTest-1881682297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.6266ce9c-5848-4ae6-853e-92aba9cf01a5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:28 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-a70d7315-afcd-4eae-a093-e887eade20e3 tempest-VolumeDependencyTests-1320295309 None] Deleted volume successfully. Feb 27 02:15:28 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.6266ce9c-5848-4ae6-853e-92aba9cf01a5 Feb 27 02:15:28 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:28 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a70d7315-afcd-4eae-a093-e887eade20e3 tempest-VolumeDependencyTests-1320295309 None] Lock "cinder-6b52880e-5e9d-47ff-a208-ba443ecb9787-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:29 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90298f64-e306-4097-9d79-72bc7b3e3867 tempest-CinderUnicodeTest-1881682297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.6266ce9c-5848-4ae6-853e-92aba9cf01a5" returned: 0 in 0.415s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90298f64-e306-4097-9d79-72bc7b3e3867 tempest-CinderUnicodeTest-1881682297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:29 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.info Feb 27 02:15:29 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:29 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90298f64-e306-4097-9d79-72bc7b3e3867 tempest-CinderUnicodeTest-1881682297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.info" returned: 0 in 0.423s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:29 devstack cinder-volume[82738]: WARNING cinder.volume.drivers.remotefs [None req-90298f64-e306-4097-9d79-72bc7b3e3867 tempest-CinderUnicodeTest-1881682297 None] /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.info is being set with open permissions: ugo+rw Feb 27 02:15:29 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90298f64-e306-4097-9d79-72bc7b3e3867 tempest-CinderUnicodeTest-1881682297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.info {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:29 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.info Feb 27 02:15:29 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:30 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-90298f64-e306-4097-9d79-72bc7b3e3867 tempest-CinderUnicodeTest-1881682297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.info" returned: 0 in 0.411s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-90298f64-e306-4097-9d79-72bc7b3e3867 tempest-CinderUnicodeTest-1881682297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.905s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:30 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-90298f64-e306-4097-9d79-72bc7b3e3867 tempest-CinderUnicodeTest-1881682297 None] Create snapshot completed successfully Feb 27 02:15:30 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] Acquiring lock "cinder-6266ce9c-5848-4ae6-853e-92aba9cf01a5-delete_snapshot" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:30 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] Lock "cinder-6266ce9c-5848-4ae6-853e-92aba9cf01a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:30 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] Acquiring lock "cinder-quobyte-578acbf6-28c8-45cc-bbfa-4c72f52ac437" by "delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:30 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] Lock "cinder-quobyte-578acbf6-28c8-45cc-bbfa-4c72f52ac437" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:30 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] Acquiring lock "cinder-quobyte-6266ce9c-5848-4ae6-853e-92aba9cf01a5" by "_delete_snapshot" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:30 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] Lock "cinder-quobyte-6266ce9c-5848-4ae6-853e-92aba9cf01a5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:30 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] Deleting offline snapshot 6266ce9c-5848-4ae6-853e-92aba9cf01a5 of volume 578acbf6-28c8-45cc-bbfa-4c72f52ac437 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:15:30 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] snapshot_file for this snap is: volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.6266ce9c-5848-4ae6-853e-92aba9cf01a5 {{(pid=82738) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:15:30 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b35b56-baf0-4a87-9231-2fd3b3ce7dda]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.6266ce9c-5848-4ae6-853e-92aba9cf01a5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:30 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.6266ce9c-5848-4ae6-853e-92aba9cf01a5 Feb 27 02:15:30 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:30 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.6266ce9c-5848-4ae6-853e-92aba9cf01a5" returned: 0 in 0.473s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:30 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.remotefs [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82738) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:15:30 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[8990752f-6484-495d-bf1e-4ea8b6d1e863]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:30 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:30 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437 Feb 27 02:15:30 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:31 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437" returned: 0 in 0.486s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.6266ce9c-5848-4ae6-853e-92aba9cf01a5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:31 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.6266ce9c-5848-4ae6-853e-92aba9cf01a5 Feb 27 02:15:31 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:31 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.6266ce9c-5848-4ae6-853e-92aba9cf01a5" returned: 0 in 0.447s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:31 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.6266ce9c-5848-4ae6-853e-92aba9cf01a5 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:31 devstack sudo[91069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.6266ce9c-5848-4ae6-853e-92aba9cf01a5 Feb 27 02:15:31 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:32 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437.6266ce9c-5848-4ae6-853e-92aba9cf01a5" returned: 0 in 0.440s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:32 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] Lock "cinder-quobyte-6266ce9c-5848-4ae6-853e-92aba9cf01a5" released by "_delete_snapshot" :: held 1.926s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:32 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] Lock "cinder-quobyte-578acbf6-28c8-45cc-bbfa-4c72f52ac437" released by "delete_snapshot" :: held 1.946s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:32 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] Created reservations ['c2769027-ab3d-4652-b3cf-cac8c6328c3c', 'ed66a5b8-d0d1-4410-89a0-7c705bbb8fb2', 'e7587bad-b736-4ee5-8d86-66f68feb131f', '29c8557e-e346-4d04-b8b7-bbb7ad1ae3c4'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:32 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] Delete snapshot completed successfully. Feb 27 02:15:32 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-a1ee89c9-4811-46f9-94aa-5048c39d5f2a tempest-CinderUnicodeTest-1881682297 None] Lock "cinder-6266ce9c-5848-4ae6-853e-92aba9cf01a5-delete_snapshot" released by "delete_snapshot" :: held 2.030s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:32 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4ec297a4-7300-4d63-8224-cd2919a9c5f9 tempest-CinderUnicodeTest-1881682297 None] Acquiring lock "cinder-578acbf6-28c8-45cc-bbfa-4c72f52ac437-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:32 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4ec297a4-7300-4d63-8224-cd2919a9c5f9 tempest-CinderUnicodeTest-1881682297 None] Lock "cinder-578acbf6-28c8-45cc-bbfa-4c72f52ac437-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:32 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4ec297a4-7300-4d63-8224-cd2919a9c5f9 tempest-CinderUnicodeTest-1881682297 None] Acquiring lock "cinder-quobyte-578acbf6-28c8-45cc-bbfa-4c72f52ac437" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:32 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4ec297a4-7300-4d63-8224-cd2919a9c5f9 tempest-CinderUnicodeTest-1881682297 None] Lock "cinder-quobyte-578acbf6-28c8-45cc-bbfa-4c72f52ac437" acquired by "delete_volume" :: waited 0.007s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:32 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bed6a9-c071-4012-8c9e-9c2474bfac3f]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4ec297a4-7300-4d63-8224-cd2919a9c5f9 tempest-CinderUnicodeTest-1881682297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:32 devstack sudo[91072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437 Feb 27 02:15:32 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:32 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4ec297a4-7300-4d63-8224-cd2919a9c5f9 tempest-CinderUnicodeTest-1881682297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437" returned: 0 in 0.508s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:32 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4ec297a4-7300-4d63-8224-cd2919a9c5f9 tempest-CinderUnicodeTest-1881682297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:32 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437 Feb 27 02:15:32 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:33 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4ec297a4-7300-4d63-8224-cd2919a9c5f9 tempest-CinderUnicodeTest-1881682297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-578acbf6-28c8-45cc-bbfa-4c72f52ac437" returned: 0 in 0.424s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:33 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4ec297a4-7300-4d63-8224-cd2919a9c5f9 tempest-CinderUnicodeTest-1881682297 None] Lock "cinder-quobyte-578acbf6-28c8-45cc-bbfa-4c72f52ac437" released by "delete_volume" :: held 0.973s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:33 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-4ec297a4-7300-4d63-8224-cd2919a9c5f9 tempest-CinderUnicodeTest-1881682297 None] Created reservations ['a0fceb75-b385-4b21-947b-4cbc933423b9', '1298322e-262e-460b-a49b-49ca033fe4e9', 'cc7e2910-f8b2-449f-bc6f-1ad253158cf8', '36226efc-39cc-46f9-9ca8-053fe7bf602d'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4ec297a4-7300-4d63-8224-cd2919a9c5f9 tempest-CinderUnicodeTest-1881682297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4ec297a4-7300-4d63-8224-cd2919a9c5f9 tempest-CinderUnicodeTest-1881682297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-4ec297a4-7300-4d63-8224-cd2919a9c5f9 tempest-CinderUnicodeTest-1881682297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:33 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-4ec297a4-7300-4d63-8224-cd2919a9c5f9 tempest-CinderUnicodeTest-1881682297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-4ec297a4-7300-4d63-8224-cd2919a9c5f9 tempest-CinderUnicodeTest-1881682297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4ec297a4-7300-4d63-8224-cd2919a9c5f9 tempest-CinderUnicodeTest-1881682297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:33 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:15:33 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:33 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-6378d999-766a-4b07-a02e-6480c6984907 tempest-CinderUnicodeTest-1881682297 None] Acquiring lock "cinder-97e4fb0a-75ac-4356-a6b8-56934a24cb13-delete_volume" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:33 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-6378d999-766a-4b07-a02e-6480c6984907 tempest-CinderUnicodeTest-1881682297 None] Lock "cinder-97e4fb0a-75ac-4356-a6b8-56934a24cb13-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:33 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-6378d999-766a-4b07-a02e-6480c6984907 tempest-CinderUnicodeTest-1881682297 None] Acquiring lock "cinder-quobyte-97e4fb0a-75ac-4356-a6b8-56934a24cb13" by "delete_volume" {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:15:33 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-6378d999-766a-4b07-a02e-6480c6984907 tempest-CinderUnicodeTest-1881682297 None] Lock "cinder-quobyte-97e4fb0a-75ac-4356-a6b8-56934a24cb13" acquired by "delete_volume" :: waited 0.010s {{(pid=82738) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:15:33 devstack cinder-volume[82738]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ff9e8a-8ac4-4699-b71e-dd6bbafd5483]: (4, 'qcow2') {{(pid=83466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:15:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6378d999-766a-4b07-a02e-6480c6984907 tempest-CinderUnicodeTest-1881682297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-97e4fb0a-75ac-4356-a6b8-56934a24cb13 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:33 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-97e4fb0a-75ac-4356-a6b8-56934a24cb13 Feb 27 02:15:33 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:33 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:33 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-4ec297a4-7300-4d63-8224-cd2919a9c5f9 tempest-CinderUnicodeTest-1881682297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.403s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:33 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-4ec297a4-7300-4d63-8224-cd2919a9c5f9 tempest-CinderUnicodeTest-1881682297 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:15:33 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-4ec297a4-7300-4d63-8224-cd2919a9c5f9 tempest-CinderUnicodeTest-1881682297 None] Deleted volume successfully. Feb 27 02:15:33 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-4ec297a4-7300-4d63-8224-cd2919a9c5f9 tempest-CinderUnicodeTest-1881682297 None] Lock "cinder-578acbf6-28c8-45cc-bbfa-4c72f52ac437-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:34 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6378d999-766a-4b07-a02e-6480c6984907 tempest-CinderUnicodeTest-1881682297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-97e4fb0a-75ac-4356-a6b8-56934a24cb13" returned: 0 in 0.492s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6378d999-766a-4b07-a02e-6480c6984907 tempest-CinderUnicodeTest-1881682297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-97e4fb0a-75ac-4356-a6b8-56934a24cb13 {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:34 devstack sudo[91088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-97e4fb0a-75ac-4356-a6b8-56934a24cb13 Feb 27 02:15:34 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:34 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6378d999-766a-4b07-a02e-6480c6984907 tempest-CinderUnicodeTest-1881682297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec/volume-97e4fb0a-75ac-4356-a6b8-56934a24cb13" returned: 0 in 0.414s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:34 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-6378d999-766a-4b07-a02e-6480c6984907 tempest-CinderUnicodeTest-1881682297 None] Lock "cinder-quobyte-97e4fb0a-75ac-4356-a6b8-56934a24cb13" released by "delete_volume" :: held 0.930s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:34 devstack cinder-volume[82738]: DEBUG cinder.quota [None req-6378d999-766a-4b07-a02e-6480c6984907 tempest-CinderUnicodeTest-1881682297 None] Created reservations ['07826177-c920-404d-987b-ad9e10a8afad', '35103eb8-9e63-4a6b-b1c8-e203c1f74a73', 'dba9faf4-edaf-492a-80aa-be37dd42bcef', '5752fa5f-eb70-48de-8f71-e948774418af'] {{(pid=82738) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:15:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6378d999-766a-4b07-a02e-6480c6984907 tempest-CinderUnicodeTest-1881682297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6378d999-766a-4b07-a02e-6480c6984907 tempest-CinderUnicodeTest-1881682297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:34 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-6378d999-766a-4b07-a02e-6480c6984907 tempest-CinderUnicodeTest-1881682297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf': None} {{(pid=82738) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:34 devstack cinder-volume[82738]: DEBUG cinder.volume.drivers.quobyte [None req-6378d999-766a-4b07-a02e-6480c6984907 tempest-CinderUnicodeTest-1881682297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1098d7f4-7ae6-4b78-b0c6-6efe7035eeaf'] {{(pid=82738) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.lockutils [None req-6378d999-766a-4b07-a02e-6480c6984907 tempest-CinderUnicodeTest-1881682297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82738) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:34 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6378d999-766a-4b07-a02e-6480c6984907 tempest-CinderUnicodeTest-1881682297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:34 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec Feb 27 02:15:34 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:35 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:35 devstack cinder-volume[82738]: DEBUG oslo_concurrency.processutils [None req-6378d999-766a-4b07-a02e-6480c6984907 tempest-CinderUnicodeTest-1881682297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c6b89971015b7964f981db9888a0bec" returned: 0 in 0.467s {{(pid=82738) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:35 devstack cinder-volume[82738]: DEBUG cinder.manager [None req-6378d999-766a-4b07-a02e-6480c6984907 tempest-CinderUnicodeTest-1881682297 None] Notifying Schedulers of capabilities ... {{(pid=82738) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:15:35 devstack cinder-volume[82738]: INFO cinder.volume.manager [None req-6378d999-766a-4b07-a02e-6480c6984907 tempest-CinderUnicodeTest-1881682297 None] Deleted volume successfully. Feb 27 02:15:35 devstack cinder-volume[82738]: DEBUG cinder.coordination [None req-6378d999-766a-4b07-a02e-6480c6984907 tempest-CinderUnicodeTest-1881682297 None] Lock "cinder-97e4fb0a-75ac-4356-a6b8-56934a24cb13-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82738) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:15:44 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:UPDATE=267,cinder:DELETE=20,cinder:SELECT=201,cinder:INSERT=66 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:15:45 devstack cinder-volume[82738]: DEBUG dbcounter [-] [82738] Writing DB stats cinder:UPDATE=306,cinder:SELECT=202,cinder:INSERT=74,cinder:DELETE=30 {{(pid=82738) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}